Software Engineer (python, backend)

Python
Anywhere, Silicon Valley
August 11, 2021
Full Time

Apply for this job

Email *

Job Description

Company

Big Data Federation tackles complex financial and economic problems. We apply machine-learning technologies to our mass data to generate predictions and signals for our asset management subsidiary. Our team comprises a group of technologists, mathematicians, data scientists, industry analysts, economists, and programmers. The company was incorporated in 2015, is headquartered in San Jose, California and has an European office in Moldova. We are backed by one of the world’s largest venture capital firms.

Job Profile

You will join an experienced and diverse team of software engineers and data scientists as a key contributor to our predictive analytics platform, where you will be responsible for ingesting new data sources into our data platform: this entails creating docker containers which customize the retrieval, post-processing/validation and storage of each data source into our private cloud. You will work with data vendors and our own data scientists to optimize the ingestion process for each source: from prototype through deployment as a micro-service to our data platform. You are encouraged to develop your full-stack engineering skills so you can help develop/maintain the data platform itself.

Responsibilities

  • Create various backend micro-services, maintain existing one, actively participate in the platform development process.
  • Create and maintain new features for data lake like data platform
  • Create and maintain existing data ingestion pipelines which include: web scraping, etl procedures, other data manipulation
  • Work with variety of software systems including software for version control, continuous integration, continuous deployment, performance data collection and analysis, systems monitoring and more
  • Automate the compilation, continuous integration, testing, packaging, and distribution of multiple software components
  • Investigate failures, fix them and execute root-cause analysis
  • Engineer systems and tools to support the build, integration and verification of complex software systems
  • Create and maintain websites backend: python3, flask, Django.

Experience

  • Demonstrated success deploying and scaling high traffic services in AWS (AMI’s, EC2, S3, CloudWatch, ECS, VPC, RedShift, Network Routing/ACL’s, ELB)
  • Networking knowledge and ability to maintain various server web server software (NGINX, OpenResty, Apache etc.)
  • Experience implementing and managing CI/CD with Jenkins, Docker, AWS Fargate and AWS ECS clusters
  • Very good experience with Python3 and frameworks (django/flask), micro-services development, data-bases (mysql) is absolutely a must.
  • Extremely comfortable with Linux, shell-scripting, and git
  • Experience with Kubernetes and Google Cloud would be a plus
  • Experiences with IAC tool such Terraform or Ansible would be a plus
  • Experience with other languages: R, JS, Go, Lua, Ruby would be a plus
  • Experience with dev-ops, cloud infrastructure, ci/cd (Jenkins) is a plus
  • Experience with Big Data dbs and associated tools is a plus
  • Thrive in a startup/fast-paced environment
  • Excellent oral and written communication skills

Qualifications

  • Bachelor’s degree in computer science or related field, or equivalent experience
  • 4+ years of experience

Compensation

  • Competitive salary; Stock options; Health benefits: medical, vision, and dental; Paid time off; Life insurance; Short- and long-term disability.

Please send cover letter and resume to [email protected].

Related Jobs