Technical Architect, (Big Data)
Bengaluru, Delhi, Gurgaon, Kolkata,Chennai,Hyderabad,Pune,Indore,Jaipur and Ahmedabad
Srijan Technologies
Srijan is a digital experience services company that helps global Fortune 500s to nonprofits build transformative digital paths to a better future.Location: Bengaluru, Delhi, Gurgaon, Kolkata,Chennai,Hyderabad,Pune,Indore,Jaipur and Ahmedabad,None,None
About Us:
Srijan is a global engineering firm that builds transformative digital paths to better futures for Fortune 500 enterprises and nonprofits all over the world. Headquartered in India, Srijan operates in 9 countries, including Singapore, the Philippines, Malaysia, Hong Kong, the USA, UK, Germany, Australia, and Japan. The company has championed open-source technologies over the last two decades, bringing advanced engineering capabilities and agile practices to some of the biggest names across Media, BFSI, FMCG, Aviation, Telecom, Technology, and others.
Srijan started off with specializing in building PHP-based open-source content management systems (CMS), specifically in Drupal. Now, we build and modernize digital systems, by leveraging cloud, data, API, and platform centric technologies to help enterprises adapt to changing business models and market demands. We create feature-rich platforms for experience, engagement, collaboration, and insight- designed to be high-performing, digitally transformative, scalable, and secure.
Srijan works largely with enterprises or mid-large-sized global firms and focuses on recurring business from these accounts, thereby bringing much-needed predictability of revenue for high-growth companies. Our teams bring on board a unique mix of technical expertise and business acumen, to understand and deliver exactly what your business needs. Srijan leads in Drupal with 350+ Drupal engineers, 75+ Acquia certified Drupal developers and is amongst the 4th globally. With preferred partnerships with Acquia, advanced consulting partners with AWS, Google Apigee, and services relationship with VMWare, Srijan offers the best technology stack in the market.
Big Data Architect -
Srijan is hiring for a strong dedicated Professional for the Big Data Architect role. An ideal candidate must have total 7+ years of experience with exposure to Big Data Technologies and good experience with Kafka. Good communication skills, exposure to handling International clients, etc.
Role:
A Big Data Architect with pyspark (primary focus), aws and Hadoop skill sets to work on an exciting Streaming / Data Engineering team (7+ years of total experience)
- Develop both deployment architecture and scripts for automated system deployment in an On-Premise as well as Cloud (AWS)
- Bring forward ideas to experiment and work in teams to transform ideas to reality
- Architect data structures that meet the reporting timelines
- Work directly with engineering teams for design and build their development requirements
- Maintain high standards of software quality by establishing good practices and habits within the development team while delivering solutions on time and on budget.
- Facilitate the agile development process through daily scrum, sprint planning, sprint demo, and retrospective meetings.
- Participate in peer-reviews of solution designs and related code
- Analyze and resolve technical and application problems
- Proven communication skills, both written and oral
- Demonstrated ability to quickly learn new tools and paradigms to deploy cutting edge solutions
- Create large scale deployments using newly conceptualized methodologies
Skills:
- Proven hands-on experience with Hadoop stack (HDFS, Map Reduce, Spark).
- Core development experience in one or more of these languages: Java, Python / PySpark, Scala etc.
- Good experience in developing Producers and Consumers for Kafka as well as custom Connectors for Kafka
- Experience developing applications using (Architecture), Consumer APIs, Real-time Data pipelines/Streaming.
- Experience with developing KSQL queries and best practices of using KSQL vs KStreams will be an added advantage
- Deep understanding of different messaging paradigms (pub/sub, queuing), as well as delivery models, quality-of-service, and fault-tolerance architectures
- Expertise with Hadoop ecosystem, primarily pySpark, fi etc.
- Experience with integration of data from multiple data sources
- Experience with stream-processing systems: Storm, Spark-Streaming, etc. will be ad advantage
- Experience with relational SQL and NoSQL databases, one or more of DBs like Postgres, Cassandra, HBase, Cassandra, MongoDB etc.
- Experience with AWS cloud services like S3, EC2, EMR, RDS, Redshift will be an added advantage
- Excellent in Data structures & algorithms and good in analytical skills
- Strong communication skills
- Ability to work with and collaborate across the team
- A good "can do" attitude.
Tags: Agile APIs Architecture AWS Big Data Cassandra Consulting Data pipelines EC2 Engineering Hadoop HBase HDFS Kafka Map Reduce MongoDB NoSQL PHP Pipelines PostgreSQL PySpark Python Redshift Scala Scrum Spark SQL Streaming
Perks/benefits: Startup environment
More jobs like this
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open MLOps Engineer jobs
- Open Data Science Manager jobs
- Open Lead Data Analyst jobs
- Open Data Manager jobs
- Open Senior Business Intelligence Analyst jobs
- Open Data Engineer II jobs
- Open Power BI Developer jobs
- Open Sr Data Engineer jobs
- Open Principal Data Engineer jobs
- Open Business Intelligence Developer jobs
- Open Junior Data Scientist jobs
- Open Data Analytics Engineer jobs
- Open Product Data Analyst jobs
- Open Data Scientist II jobs
- Open Sr. Data Scientist jobs
- Open Senior Data Architect jobs
- Open Business Data Analyst jobs
- Open Data Analyst Intern jobs
- Open Big Data Engineer jobs
- Open Manager, Data Engineering jobs
- Open Azure Data Engineer jobs
- Open Junior Data Engineer jobs
- Open Data Product Manager jobs
- Open Data Quality Analyst jobs
- Open Principal Data Scientist jobs
- Open GCP-related jobs
- Open Data quality-related jobs
- Open Business Intelligence-related jobs
- Open ML models-related jobs
- Open Java-related jobs
- Open Data management-related jobs
- Open Privacy-related jobs
- Open Finance-related jobs
- Open Data visualization-related jobs
- Open Deep Learning-related jobs
- Open PhD-related jobs
- Open APIs-related jobs
- Open TensorFlow-related jobs
- Open PyTorch-related jobs
- Open NLP-related jobs
- Open Consulting-related jobs
- Open Snowflake-related jobs
- Open CI/CD-related jobs
- Open LLMs-related jobs
- Open Kubernetes-related jobs
- Open Generative AI-related jobs
- Open Data governance-related jobs
- Open Hadoop-related jobs
- Open Airflow-related jobs
- Open Docker-related jobs