Software Engineer (python, backend)

Job Description

Company

Big Data Federation tackles complex financial and economic problems. We apply machine-learning technologies to our mass data to generate predictions and signals for our asset management subsidiary. Our team comprises a group of technologists, mathematicians, data scientists, industry analysts, economists, and programmers. The company was incorporated in 2015, is headquartered in San Jose, California and has an European office in Moldova. We are backed by one of the world’s largest venture capital firms.

Job Profile

You will join an experienced and diverse team of software engineers and data scientists as a key contributor to our predictive analytics platform, where you will be responsible for ingesting new data sources into our data platform: this entails creating docker containers which customize the retrieval, post-processing/validation and storage of each data source into our private cloud. You will work with data vendors and our own data scientists to optimize the ingestion process for each source: from prototype through deployment as a micro-service to our data platform. You are encouraged to develop your full-stack engineering skills so you can help develop/maintain the data platform itself.

Responsibilities

• Create various backend micro-services, maintain existing one, actively participate in the platform development process.
• Create and maintain new features for data lake like data platform
• Create and maintain existing data ingestion pipelines which include: web scraping, etl procedures, other data manipulation
• Work with variety of software systems including software for version control, continuous integration, continuous deployment, performance data collection and analysis, systems monitoring and more
• Automate the compilation, continuous integration, testing, packaging, and distribution of multiple software components
• Investigate failures, fix them and execute root-cause analysis
• Engineer systems and tools to support the build, integration and verification of complex software systems
• Create and maintain websites backend: python3, flask, Django.

Experience

• Good knowledge of Python 3 and Django/Flask web frameworks
• Proficiency in MySQL and relational database systems in general
• Good experience and understanding of RESTful Web Services and how they fit into micro-services environment
• Pretty comfortable with UNIX like systems and git
• Good knowledge and real-world experience with testing libraries or frameworks (unittest, pytest)
• Good understanding of message brokers (Rabbit MQ, Amazon SQS) and distributed task queues (Celery, RQ)
• Experience building and managing Docker containers in a production-ready environment
• Experience with other languages: R, JS, Go, Bash, Lua, Ruby would be a plus
• Experience with Cloud Service Providers: AWS, GCP, Azure, DO would be a plus
• Excellent oral and written English communication skills

Qualifications

• Bachelor’s degree in computer science or related field
• 2+ years of experience

Compensation

Competitive salary; health insurance; paid time off.

Please send cover letter and resume to [email protected].