This job might no longer be available.
Senior Software Engineer, Cloud/Data
4 years ago
Job Description We are looking for a data engineer to help us uncover insights hidden in data obtained from a variety of sources, and help us make smarter decisions to deliver even better products.
Primary focus will be data extraction, data pipelining, data cleaning, data architecture, and machine learning.
Responsibilities- Building pipelines to stream data from different sources
- Batch extracting data from different sources when streaming is not possible
- Extending company’s data with third party sources of information when needed
- Enhancing data collection procedures to include data lineage information
- Processing, cleansing, and verifying the integrity of data used for analysis
- Define data best data representation for the different processes
- Work closely with data scientist to create and improve internal data products
Skills and Qualifications- Good domain of SQL
- Experience with AWS
- Good knowledge of source control and continuous integration practices
- Proven knowledge of background asynchronous systems
- Experience with Big Data systems
- Excellent communications skills
- Experience with Scala and Spark is a plus
- Experiences with notebooks solutions (e.g. Jupiter notebooks, R Studio notebooks, Databricks) is a plus
- Knowledge of R or python (Pandas, Scikit Learn, and other scientific computing libraries) is a good plus
Skills- Degree in computer science or proven track record of success in the industry
Additional Information- All your information will be kept confidential according to Equal Employment Opportunities guidelines.
#LI-JM1