Help us shape the future of .NET for Apache Spark

Question Title

* 1. Which of the following best describes your role?

Academic Researcher

Hobbyist

Data Engineer (Develops data processing pipelines and scripts to prepare and curate data from a variety of sources)

Developer (Develops end user applications, some of which require access to curated data)

Business Analyst (Develops reports and runs queries on curated data)

Data scientist (Build custom ML Models for a given data set and business problem)

Other (please specify)

Question Title

* 2. How would you describe your company?

Freelancer, consultant, self-employed

Start-up

Large-sized company (> 1000 employees)

Medium-sized company (100 - 1000 employees)

Small-sized company (< 100 employees)

None of the above (e.g. I am a student or hobbyist)

Other (please specify)

Question Title

* 3. What language do you use for your application development?

Python

JavaScript

SQL

PHP

Swift

Node

Scala

Julia

Java

.NET

C++

Other (please specify)

Question Title

* 4. What kind of apps are you building?

None

Games

Desktop

Internet of Things

Cloud

Web

Mobile

Other (please specify)

Question Title

* 5. How would you describe your current usage of Big Data and Apache Spark?

Not interested in Big Data

Actively developing and leveraging Big Data solutions

Interested in learning about Big Data but have not actively developed any solutions

Recently started developing Big Data solution (<6 months ago)

Other (please specify)

Question Title

* 6. What tools do you use for building your Big Data and Apache Spark jobs?

Data management tools (Azure Data Catalog, Waterline Data, Informatica, Apache Atlas etc.)

Data Ingestion Tools (Azure Data Factory, StreamSets, Talend, Oozie etc.)

ML tools (e.g. Azure ML, RapidMiner, Data Robot, Dataiku, H20.ai)

Integrated Development Environments (e.g. IntelliJ, Visual Studio, XCode, Spyder etc.)

Code Editors (e.g. Visual Studio Code, Sublime, Notepad, Vim etc.)

SQL Editor (e.g. RedGate, JetBrains DataGrip, Azure DataStudio)

Jupyter Notebooks or REPL environments

Data Wrangling tools (e.g. Paxata, Trifacta)

Other (please specify)

Question Title

* 7. Which frameworks, libraries and cloud services have you used for Big Data?

Azure EventHub (Kafka)

Cloudera / Hortonworks

Presto

Amazon EMR etc.

Azure Data Lake

Google Dataproc, BigQuery etc.

MongoDB

Azure Time Series Insights

Apache Kafka

Apache Hadoop

Microsoft Prose SDK

DataBricks

Apache Hive

AI Batch

Apache Spark

None -- I have not used Big Data

Azure HDInsight

Azure Stream Analytics

Other (please specify)

Question Title

* 8. How best would you explain the use of Big Data in your organization (e.g. Data Warehousing, Real Time/Streaming solutions, Log Processing etc.)

Question Title

* 9. Have you had a chance to play with .NET for Apache Spark? If so, how was your experience?

Yes

If Yes, please explain