Software and Data Engineer
1 October 2025 — Present
8 months 27 days
Develop, maintain, and optimize Python-based data pipelines on GCP (Dataflow, Pub/Sub, Kubernetes). Implement and refine event-driven solutions (Pub/Sub, sockets, RabbitMQ, etc.). Integrate and optimize various databases, including BigQuery, ArangoDB, Postgres, and ElasticSearch. Collaborate on crawling/scraping improvements and NLP-related features. Design, build, and maintain REST APIs and microservices (e.g., using Flask or similar frameworks). Deploy and troubleshoot services in Kubernetes or Debian Linux environments. Work closely with the front-end developer to ensure seamless data integration for internal tools.
Skills:
Data pipeline development
Event-driven architecture
Database integration and optimization
REST API design
Cross-team collaboration