A Year in Big Data 2019
For DZone Articles See Here: https://www.linkedin.com/pulse/my-top-articles-2019-timothy-spann/
It was a great year talking with the tech people of the Princeton area.
Blockchain
https://www.meetup.com/futureofdata-princeton/events/255404291/
Deep Learning
https://www.meetup.com/futureofdata-princeton/events/258560318/
Edge2AI
https://www.slideshare.net/bunkertor/cdf-edge-to-ai-with-cem-april-9-2019-princeton-fod-meetup
https://www.meetup.com/futureofdata-princeton/events/258600690/
Edge2AI in Barcelona
https://www.meetup.com/futureofdata-barcelona/events/259345951/
Enterprise IoT
https://www.meetup.com/futureofdata-princeton/events/263872145
HBase in CDP, FLaNK Stack and NiFi 1.10
https://www.meetup.com/futureofdata-princeton/events/266496424/
At other events, I got to join some amazing colleagues spreading the word about cool open source technology.
https://www.cloudera.com/about/events/edge-to-ai-city-tour/new-york.html
The Cloudera Forum for CDP in MINNEAPOLIS. I got to help out on the amazing launch of Data in Motion on Cloudera.
I got to lead all-day workshops in NYC, Boston and Washington DC. I also got to talk about and do demos on NiFi and Phoenix for Cloudera Now online and some followup webinars.
I got to speak at a few awesome conferences this year.
Dataworks Summit Barcelona (https://www.slideshare.net/bunkertor/the-edge-to-ai-deep-dive-barcelona-meetup-march-2019) https://www.datainmotion.dev/2019/03/barcelona-dataworks-summit-march-2019.html
NoSQL Day DC (https://www.datainmotion.dev/2019/05/dataworks-summit-dc-2019-report.html) See my joint talk on Phoenix and NiFi.
Dataworks Summit DC (https://dzone.com/articles/dataworks-summit-and-nosql-day-review-2019-washing) See my talks on NiFi, Blockchain and Deep Learning.
Strata NYC (https://github.com/tspannhw/StrataNYC2019) . I helped with some hands-on training sessions on Data in Motion.
Nethope Conference Puerto Rico
(https://nethopeglobalsummit2019.pathable.co/meetings/rmZ5yXXoJo4EfcaY7)
I wrote a few articles this year:
- https://www.datainmotion.dev/2019/12/iot-series-minifi-agent-on-raspberry-pi.html
- https://www.datainmotion.dev/2019/12/easy-deep-learning-in-apache-nifi-with.html
- https://www.datainmotion.dev/2019/12/princeton-new-jersey-usa-meetup-10.html
- https://www.datainmotion.dev/2019/12/hbase-20-on-cdp-on-aws.html
- https://www.datainmotion.dev/2019/11/introducing-mm-flank-apache-flink-stack.html
- https://www.datainmotion.dev/2019/11/learning-apache-flink-19.html
- https://www.datainmotion.dev/2019/11/nifi-toolkit-cli-for-nifi-110.html
- https://www.datainmotion.dev/2019/11/nifi-110-postslack-easy-image-upload.html
- https://www.datainmotion.dev/2019/11/exploring-apache-nifi-110-parameters.html
- https://www.datainmotion.dev/2019/11/learning-flink-and-analyzing-flink.html
- https://www.datainmotion.dev/2019/11/running-demo-apache-flink-application.html
- https://www.datainmotion.dev/2019/10/apache-nifi-load-balancing-via-load.html
- https://www.datainmotion.dev/2019/10/migrating-apache-flume-flows-to-apache_15.html
- https://www.datainmotion.dev/2019/10/using-grovepi-with-raspberry-pi-and.html
- https://www.datainmotion.dev/2019/10/migrating-apache-flume-flows-to-apache_9.html
- https://www.datainmotion.dev/2019/10/migrating-apache-flume-flows-to-apache_35.html
- https://www.datainmotion.dev/2019/10/migrating-apache-flume-flows-to-apache_8.html
- https://www.datainmotion.dev/2019/10/migrating-apache-flume-flows-to-apache_7.html
- https://www.datainmotion.dev/2019/10/migrating-apache-flume-flows-to-apache.html
- https://www.datainmotion.dev/2019/10/tracking-air-quality-with-apache-nifi.html
- https://www.datainmotion.dev/2019/10/monitoring-cloudera-edge-flow-manager.html
- https://www.datainmotion.dev/2019/09/powering-edge-ai-for-sensor-reading.html
- https://www.datainmotion.dev/2019/09/backup-and-restore-nifi-registry.html
- https://www.datainmotion.dev/2019/08/google-coral-tpu-with-edge-devices-and.html
- https://www.datainmotion.dev/2019/08/updating-machine-learning-models-at.html
- https://www.datainmotion.dev/2019/08/generating-json-data-in-apache-nifi.html
- https://www.datainmotion.dev/2019/08/using-cloudera-streams-messaging.html
- https://www.datainmotion.dev/2019/08/gtfs-real-time-streaming-with-apache.html
- https://www.datainmotion.dev/2019/08/efm-series-using-minifi-agents-on.html
- https://www.datainmotion.dev/2019/08/migrating-apache-flume-flows-to-apache.html
- https://www.datainmotion.dev/2019/08/rapid-iot-development-with-cloudera.html
- https://www.datainmotion.dev/2019/08/creating-apache-kafka-topics.html
- https://www.datainmotion.dev/2019/08/edge-processing-with-jetson-nano-part-3.html
- https://www.datainmotion.dev/2019/07/edge-processing-with-jetson-nano-part-2.html
- https://www.datainmotion.dev/2019/07/edge-data-processing-with-jetson-nano.html
- https://www.datainmotion.dev/2019/07/philadelphia-open-crime-data-on-phoenix.html
- https://www.datainmotion.dev/2019/07/powering-edge-ai-with-powerful-jetson.html
- https://www.datainmotion.dev/2019/06/performance-testing-apache-nifi-part-1.html
- https://www.datainmotion.dev/2019/05/dataworks-summit-dc-2019-report.html
- https://www.datainmotion.dev/2019/05/reading-opendata-json-and-storing-into.html
- https://www.datainmotion.dev/2019/05/cloudera-edge-management-introduction.html
- https://www.datainmotion.dev/2019/04/streams-messaging-manager-smm-rest-api.html
- https://www.datainmotion.dev/2019/04/energy-monitoring-via-apache-nifi.html
- https://www.datainmotion.dev/2019/04/iot-edge-use-cases-with-apache-kafka.html
- https://dzone.com/articles/combining-djlai-with-apache-nifi-for-deep-learning
- https://dzone.com/articles/modern-apache-nifi-load-balancing
- https://dzone.com/articles/exploring-apache-nifi-110-parameters-and-stateless
- https://dzone.com/articles/migrating-apache-flume-flows-to-apache-nifi-kafka
- https://dzone.com/articles/real-time-transit-feed-data-processing
- https://dzone.com/articles/efm-series-using-minifi-agents-on-raspberry-pi-4-w
- https://dzone.com/articles/creating-apache-kafka-topics-dynamically-as-part-o
- https://dzone.com/articles/edge-data-processing-with-jetson-nano
- https://dzone.com/articles/powering-edge-ai-with-the-powerful-jetson-nano
- https://dzone.com/articles/dataworks-summit-and-nosql-day-review-2019-washing
- https://dzone.com/articles/advanced-xml-processing-with-apache-nifi-191
- https://dzone.com/articles/iot-device-data-and-stream-processing
- https://dzone.com/articles/integration-of-apache-nifi-and-cloudera-data-scien
- https://dzone.com/articles/reading-sudo-logs-with-apache-nifi
- https://dzone.com/articles/using-cloudera-data-science-workbench-with-apache
- https://dzone.com/articles/sochain-bitcoin-dogecoin-and-litecoin-data-rest-ap
- https://dzone.com/articles/working-with-proximity-beacons
- https://dzone.com/articles/sensors-utilizing-breakout-garden https://www.datainmotion.dev/2019/08/edge-processing-with-jetson-nano-part-3.html- https://community.cloudera.com/t5/Community-Articles/Exploring-Apache-NiFi-1-10-Parameters-and-Stateless-Engine/ta-p/283266
- https://community.cloudera.com/t5/Community-Articles/Edge-Data-Processing-with-Jetson-Nano-Part-3-AI-Integration/ta-p/93642
- https://community.cloudera.com/t5/Community-Articles/Migrating-Apache-Flume-Flows-to-Apache-NiFi-Kafka-Source-to/ta-p/278870
- https://community.cloudera.com/t5/Community-Articles/Using-Raspberry-Pi-3B-with-Apache-NiFi-MiNiFi-and-Google/ta-p/249478
- https://dev.to/tspannhw/iot-series-minifi-agent-on-raspberry-pi-4-with-enviro-hat-for-environmental-monitoring-and-analytics-l8d
- https://dev.to/tspannhw/easy-deep-learning-in-apache-nifi-with-djl-2d79
Here are my slides from 2019:
- https://www.slideshare.net/bunkertor/tracking-crime-as-it-occurs-with-apache-phoenix-apache-hbase-and-apache-nifi
- https://www.slideshare.net/bunkertor/apache-deep-learning-202-washington-dc-dws-2019
- https://www.slideshare.net/MehulShah218/cold-supply-chain-logistics-using-sensors-apache-ni-fi-and-the-hyperledger-fabric-blockchain-platform
- https://www.slideshare.net/bunkertor/introduction-to-apache-nifi-dws19-dws-dc-2019
- https://www.slideshare.net/bunkertor/edge-to-ai-analytics-from-edge-to-cloud-with-efficient-movement-of-machine-data-147411788
- https://www.slideshare.net/bunkertor/apache-deep-learning-202-washington-dc-dws-2019
A Decade End Wrap Up 2010-2019
Blockchain and Cryptocurrency blew up and then blew up. There's a few solid use cases though and the similarities between early Hadoop and Blockchain are interesting. You can't count this stuff out.
What's Coming in 2020
- Cloud Enterprise Data Platforms
- Hybrid Cloud
- Streaming with Flink, Kafka, NiFi
- AI at the Edge with Microcontrollers and Small Devices
- Voice Data In Queries
- Event Handler as a Service (Automatic Kafka Message Reading)
- More Powerful Parameter Based Modular Streaming
- Cloud First For Big Data
- Log Handling Moves to MiNiFi
- Full AI At The Edge with Deployable Models
- More Powerful Edge TPU/GPU/VPU
- Kafka is everywhere
- Open Source UI Driven Event Engines
- FLaNK Stack gains popularity
References :
Top comments (0)