Help us shape the future of .NET for Apache Spark

Question Title

* 1. Which of the following best describes your role?

Data scientist (Build custom ML Models for a given data set and business problem)

Hobbyist

Academic Researcher

Developer (Develops end user applications, some of which require access to curated data)

Business Analyst (Develops reports and runs queries on curated data)

Data Engineer (Develops data processing pipelines and scripts to prepare and curate data from a variety of sources)

Other (please specify)

Question Title

* 2. How would you describe your company?

None of the above (e.g. I am a student or hobbyist)

Medium-sized company (100 - 1000 employees)

Start-up

Small-sized company (< 100 employees)

Large-sized company (> 1000 employees)

Freelancer, consultant, self-employed

Other (please specify)

Question Title

* 3. What language do you use for your application development?

Swift

Node

Python

Scala

JavaScript

C++

.NET

Julia

Java

PHP

SQL

Other (please specify)

Question Title

* 4. What kind of apps are you building?

Internet of Things

Web

Cloud

Desktop

None

Mobile

Games

Other (please specify)

Question Title

* 5. How would you describe your current usage of Big Data and Apache Spark?

Actively developing and leveraging Big Data solutions

Not interested in Big Data

Recently started developing Big Data solution (<6 months ago)

Interested in learning about Big Data but have not actively developed any solutions

Other (please specify)

Question Title

* 6. What tools do you use for building your Big Data and Apache Spark jobs?

Code Editors (e.g. Visual Studio Code, Sublime, Notepad, Vim etc.)

Data Wrangling tools (e.g. Paxata, Trifacta)

Jupyter Notebooks or REPL environments

Data Ingestion Tools (Azure Data Factory, StreamSets, Talend, Oozie etc.)

ML tools (e.g. Azure ML, RapidMiner, Data Robot, Dataiku, H20.ai)

Data management tools (Azure Data Catalog, Waterline Data, Informatica, Apache Atlas etc.)

SQL Editor (e.g. RedGate, JetBrains DataGrip, Azure DataStudio)

Integrated Development Environments (e.g. IntelliJ, Visual Studio, XCode, Spyder etc.)

Other (please specify)

Question Title

* 7. Which frameworks, libraries and cloud services have you used for Big Data?

Azure Stream Analytics

Microsoft Prose SDK

Azure Data Lake

Apache Hive

Amazon EMR etc.

Google Dataproc, BigQuery etc.

Azure HDInsight

Apache Spark

Azure Time Series Insights

AI Batch

Apache Kafka

None -- I have not used Big Data

Cloudera / Hortonworks

MongoDB

Azure EventHub (Kafka)

Presto

Apache Hadoop

DataBricks

Other (please specify)

Question Title

* 8. How best would you explain the use of Big Data in your organization (e.g. Data Warehousing, Real Time/Streaming solutions, Log Processing etc.)

Question Title

* 9. Have you had a chance to play with .NET for Apache Spark? If so, how was your experience?

Yes

If Yes, please explain