We are the Azure Data teams part of the Azure organization. Azure Data teams present interesting challenges in technologies such as operational store, big-data, and governance. We build reliable, highly scalable and highly performing distributed systems for governance and data analytics on Azure. We work with various open-source technologies like Atlas, Spark, ElasticSearch, Kubernetes, etc., and make contributions to these technologies. We are building next generation of Microsoft's exa-scale Data Governance service, leveraging Microsoft Purview, and help us take it to the next level of functionality and scale. This is a once in a lifetime opportunity to be part of a very agile team, take on hard distributed system problems and ship mission-critical features at a rapid pace. Microsoft puts customers in control of their personal data and backs this commitment with continuous investment in governance infrastructure. Our team is responsible for Governance Compliance of all companies' data, and we are cataloging, classifying, and enforcing policies for billions of data assets daily. We need collaborative developers who can think big, deliver on those big challenges, and along the way, change the world. We're looking for engineers to build them from the ground up.
Azure Data Governance China team has openings ranging from entry to Senior. We are seeking top talents with passion for big data, data discovery and data governance. You will learn cutting edge big data services, like catalog, Spark, Kubernetes, lineage, scanning, workflow and search engine. You are expected to learn hundreds of industrial data stores, build scalable scanning and metadata connector framework to retrieve metadata and classification from those stores in an extensible and scalable approach. You will have opportunities to reach out to customers to understand / solve a real customer pain points.
We are looking for a great software engineer with experiences in backend services and data pipelines to build the next generation of Microsoft's data governance services.
required qualifications:
preferred qualifications:
# purview
# data governance
- Faster career growth due to high visibility and high business impact of the service.
- Autonomy to drive major feature areas.
- Cutting edge technologies (Spark, Kubernetes, Atlas, Egeria, Elastic Search, Flow Engine, GraphDB, NLP, connector framework, Scanning, Airflow).
- Collaborative, supportive culture
Azure Data Governance China team has openings ranging from entry to Senior. We are seeking top talents with passion for big data, data discovery and data governance. You will learn cutting edge big data services, like catalog, Spark, Kubernetes, lineage, scanning, workflow and search engine. You are expected to learn hundreds of industrial data stores, build scalable scanning and metadata connector framework to retrieve metadata and classification from those stores in an extensible and scalable approach. You will have opportunities to reach out to customers to understand / solve a real customer pain points.
We are looking for a great software engineer with experiences in backend services and data pipelines to build the next generation of Microsoft's data governance services.
- Design and develop large scale distributed systems.
- Deploy and operate services in production.
- Work with customers to resolve their issues and gather requirements for new features.
- Work with Microsoft stakeholders in and out of the immediate team to make sure our code is compliant and secure, as much as it solved the customer problems.
required qualifications:
- 2+ years of professional software development experience.
- fluent in one or more programming language like java, golang and c#.
- solid data structure knowledge and familiar with common algorithms.
- good knowledge of oo design and basic understanding with functional programming concepts
preferred qualifications:
- bs/ms in computer science, mathematics/physics, or engineering, or equivalent experience.
- familiar with container related technologies (docker, kubernetes).
- experience on customizing kubernetes like developing operators and define crds.
- experience with web service development and familiar with related technologies (springcloud, rest).
- experience in data governance areas like data catalog, lineage, discovery and data policy, and familiar with related technologies like apache atlas, egeria and openlineage.
- familiar with cloud platform like azure, aws, gcp, alicloud and etc.
- familiar with popular data store (relational, document, wide column, key-value, etc) like mysql, oracle, sqlserver, mongodb, cosmosdb, redis, cassandra, hbase, s3, azure storage, etc.
- familiar with big data technologies like spark, hadoop, flink and kafka.
- familiar with full text search technologies (apache lucene, elastic search & apache solr).
- familiar with graph database (neo4j, gremlin & janusgraph, etc)
- familiar with machine learning and nlp.
- familiar with workflow related technologies (apache airflow, etc).
- familiar with service mesh technologies (istio).
- familiar with modern security models like oauth and token based authentication and authorization.
- experience building and shipping production grade software or services.
- experience using agile methodologies or test-driven development (tdd).
- great curiosity and willingness to question.
- high enthusiasm, integrity, ingenuity, results-orientation, self-motivation, and resourcefulness in a fast-paced competitive environment.
- have a deep desire to work collaboratively, solve problems with groups, find win/win solutions and celebrate successes.
- get excited by the challenge of hard technical problems.
- solve problems by always leading with deep passion and empathy for customers.
# purview
# data governance
