Dec 12, 2022 FLiP Stack Weekly
People are FLiPN out about https://chat.openai.com/chat. It is a game changer, add another few years and this should be 10x better.
ChatGPT wrote me this Pulsar function:
import org.apache.pulsar.functions.api.Context;
import org.apache.pulsar.functions.api.Function;
public class BertQAFunction implements Function<String, String> {
@Override
public String process(String input, Context context) {
// Parse the input JSON into a Java object using a JSON library
// such as Jackson or Gson
MyJsonObject json = parseJson(input);
// Use the Bert QA library to perform QA on the JSON object
BertQAResult result = BertQA.runQA(json);
// Return the result as a JSON string
return result.toJson();
}
}
```
`
I then tried to build 50 more. Some are good, some are minimal, some are bad and some are just shells. An interesting start and some good ideas on functions to build. I offer the source as a starter for anyone wanting to build some functions.
[https://github.com/tspannhw/pulsar-chatgptgenerated-functions](https://github.com/tspannhw/pulsar-chatgptgenerated-functions)
Check out our channel:
[https://www.youtube.com/@streamnativecommunity8124/featured](https://www.youtube.com/@streamnativecommunity8124/featured)
### New Stuff
https://cwiki.apache.org/confluence/display/NIFI/Release+Notes#ReleaseNotes-Version1.19.0
A quick preview of Apache Pulsar + Apache Pinot.
[https://youtu.be/KMbTlmoDXXA](https://youtu.be/KMbTlmoDXXA)
[https://github.com/tspannhw/pulsar-thermal-pinot](https://github.com/tspannhw/pulsar-thermal-pinot)
### PODCAST
Take a look at recent podcasts in audio or video format.
[https://www.buzzsprout.com/2062659/11463086-messaging-streaming-and-events-101-episode-1-of-crossing-the-streams](https://www.buzzsprout.com/2062659/11463086-messaging-streaming-and-events-101-episode-1-of-crossing-the-streams)
[https://www.youtube.com/watch?v=U8aPBhlvDHU&feature=emb_imp_woyt](https://www.youtube.com/watch?v=U8aPBhlvDHU&feature=emb_imp_woyt)
{% embed https://www.youtube.com/watch?v=U8aPBhlvDHU&feature=emb_imp_woyt %}
### CODE + COMMUNITY
Join my meetup group NJ/NYC/Philly/Virtual.
[https://www.meetup.com/new-york-city-apache-pulsar-meetup/](https://www.meetup.com/new-york-city-apache-pulsar-meetup/
)
**This is Issue #62!!**
[https://github.com/tspannhw/FLiPStackWeekly](https://github.com/tspannhw/FLiPStackWeekly)
[https://www.linkedin.com/pulse/2022-schedule-tim-spann](https://www.linkedin.com/pulse/2022-schedule-tim-spann)
#### VIDEOS
[https://streamnative.io/download/pulsar-summit-san-francisco-on-demand/?utm_campaign=Pulsar%20Summit%20San%20Francisco%202022%20Videos&utm_source=Sn.io%20website%20event%20page&utm_term=Sn.io%20website%20event%20page%20-%20Pulsar%20Summit%20On-demand](https://streamnative.io/download/pulsar-summit-san-francisco-on-demand/?utm_campaign=Pulsar%20Summit%20San%20Francisco%202022%20Videos&utm_source=Sn.io%20website%20event%20page&utm_term=Sn.io%20website%20event%20page%20-%20Pulsar%20Summit%20On-demand) Collect them all
{% embed https://www.youtube.com/watch?v=gCroAjk5D_Q %}
[https://www.youtube.com/watch?v=gCroAjk5D_Q](https://www.youtube.com/watch?v=gCroAjk5D_Q)
{% embed https://www.youtube.com/embed/gCroAjk5D_Q %}
[https://www.youtube.com/watch?v=Z9zAnKBcGKI](https://www.youtube.com/watch?v=Z9zAnKBcGKI)
{% embed https://www.youtube.com/watch?v=Z9zAnKBcGKI %}
[https://www.youtube.com/watch?v=VhVs6fuf7W8](https://www.youtube.com/watch?v=VhVs6fuf7W8)
{% embed https://www.youtube.com/watch?v=VhVs6fuf7W8 %}
[https://www.youtube.com/watch?v=sJB0Fwxy2ck](https://www.youtube.com/watch?v=sJB0Fwxy2ck)
{% embed https://www.youtube.com/watch?v=sJB0Fwxy2ck %}
[https://www.youtube.com/watch?v=4Fh48IL3rUA](https://www.youtube.com/watch?v=4Fh48IL3rUA)
[https://www.youtube.com/watch?v=vwLxV48JhbQ](https://www.youtube.com/watch?v=vwLxV48JhbQ)
[https://www.youtube.com/watch?v=MN2l1duMjeA](https://www.youtube.com/watch?v=MN2l1duMjeA)
[https://www.youtube.com/watch?v=apY1Xd5JgkA](https://www.youtube.com/watch?v=apY1Xd5JgkA)
[https://www.youtube.com/watch?v=BpXJboPWpAY](https://www.youtube.com/watch?v=BpXJboPWpAY)
[https://www.youtube.com/watch?v=lepXk0u4iQ4](https://www.youtube.com/watch?v=lepXk0u4iQ4)
[https://www.youtube.com/watch?v=v7qYBQVFz_k](https://www.youtube.com/watch?v=v7qYBQVFz_k)
[https://www.youtube.com/watch?v=txidgG7xcYE](https://www.youtube.com/watch?v=txidgG7xcYE)
[https://www.youtube.com/watch?v=wNkdH1A7C_s](https://www.youtube.com/watch?v=wNkdH1A7C_s)
#### ARTICLES
[https://streamnative.io/blog/case/2022-12-05-wechat-using-apache-pulsar-to-support-the-high-throughput-real-time-recommendation-service/](https://streamnative.io/blog/case/2022-12-05-wechat-using-apache-pulsar-to-support-the-high-throughput-real-time-recommendation-service/)
[https://medium.com/@isuriamasarani87/why-http-is-a-bad-idea-for-microservices-f82e99eff9a0](https://medium.com/@isuriamasarani87/why-http-is-a-bad-idea-for-microservices-f82e99eff9a0)
[https://medium.com/@tspann/having-chatgpt-build-lightweight-stateless-streaming-microservices-for-me-a865e4475bf2](https://medium.com/@tspann/having-chatgpt-build-lightweight-stateless-streaming-microservices-for-me-a865e4475bf2)
[https://medium.com/@tspann/using-apache-pulsar-with-cloudera-sql-builder-apache-flink-b518aa9eadff](https://medium.com/@tspann/using-apache-pulsar-with-cloudera-sql-builder-apache-flink-b518aa9eadff)
[https://www.infoq.com/articles/serverless-websockets-realtime-messaging/](https://www.infoq.com/articles/serverless-websockets-realtime-messaging/)
[https://ververica.zendesk.com/hc/en-us/articles/6824103650076-How-to-Integrate-Ververica-Platform-with-Apache-Pulsar](https://ververica.zendesk.com/hc/en-us/articles/6824103650076-How-to-Integrate-Ververica-Platform-with-Apache-Pulsar)
[https://blogs.oracle.com/java/post/go-native-with-spring-boot-3-and-graalvm](https://blogs.oracle.com/java/post/go-native-with-spring-boot-3-and-graalvm)
[https://medium.com/@nifi.notes/building-an-effective-nifi-flow-queryrecord-cca5ba51afd5](https://medium.com/@nifi.notes/building-an-effective-nifi-flow-queryrecord-cca5ba51afd5)
[https://medium.com/@nifi.notes/building-an-effective-nifi-flow-b5aa1b816380](https://medium.com/@nifi.notes/building-an-effective-nifi-flow-b5aa1b816380)
[http://funnifi.blogspot.com/2022/12/using-updatedatabaserecord-for-schema.html](http://funnifi.blogspot.com/2022/12/using-updatedatabaserecord-for-schema.html)
[https://vinodhini-sd.medium.com/what-is-chatgpt-is-it-really-coming-for-your-job-why-should-you-care-3dd6bfe74339](https://vinodhini-sd.medium.com/what-is-chatgpt-is-it-really-coming-for-your-job-why-should-you-care-3dd6bfe74339)
[https://www.infoq.com/news/2022/10/apache-inlong-framework/](https://www.infoq.com/news/2022/10/apache-inlong-framework/)
[https://www.infoq.com/articles/streaming-first-real-time-ml/](https://www.infoq.com/articles/streaming-first-real-time-ml/)
[https://www.infoq.com/presentations/ml-continuous-learning/](https://www.infoq.com/presentations/ml-continuous-learning/)
[https://dev.to/_hs_/micronaut-pulsar-6bo](https://dev.to/_hs_/micronaut-pulsar-6bo)
[https://nakedsecurity.sophos.com/2022/12/08/credit-card-skimming-the-long-and-winding-road-of-supply-chain-failure/](https://nakedsecurity.sophos.com/2022/12/08/credit-card-skimming-the-long-and-winding-road-of-supply-chain-failure/)
[https://blog.rockthejvm.com/pulsar-flink/](https://blog.rockthejvm.com/pulsar-flink/)
[https://dzone.com/articles/how-to-choose-the-right-messaging-system-for-your](https://dzone.com/articles/how-to-choose-the-right-messaging-system-for-your)
[https://pulsar.apache.org/docs/2.10.x/cookbooks-non-persistent/](https://pulsar.apache.org/docs/2.10.x/cookbooks-non-persistent/)
[https://towardsdatascience.com/whats-next-for-data-engineering-in-2023-7-predictions-b57e3c1bf2d3](https://towardsdatascience.com/whats-next-for-data-engineering-in-2023-7-predictions-b57e3c1bf2d3)
#### TRAINING
Dates are January 17 - 19, 2023 from 2pm - 5pm CET / 8am - 12pm EST
Link to register: [https://www.eventbrite.com/e/465055021087](https://www.eventbrite.com/e/465055021087)
[https://streamnative.io/training/](https://streamnative.io/training/)
#### CODE
[https://github.com/tspannhw/pulsar-csp-ce](https://github.com/tspannhw/pulsar-csp-ce)
[https://github.com/tspannhw/pulsar-thermal-pinot](https://github.com/tspannhw/pulsar-thermal-pinot)
[https://github.com/tspannhw/create-nifi-pulsar-flink-apps](https://github.com/tspannhw/create-nifi-pulsar-flink-apps)
[https://github.com/flipkart-incubator/pulsar-weighted-consumer](https://github.com/flipkart-incubator/pulsar-weighted-consumer)
[https://docs.dapr.io/reference/components-reference/supported-pubsub/setup-pulsar/](https://docs.dapr.io/reference/components-reference/supported-pubsub/setup-pulsar/)
[https://github.com/micronaut-projects/micronaut-pulsar/tree/master/examples/full-java-example](https://github.com/micronaut-projects/micronaut-pulsar/tree/master/examples/full-java-example)
### EVENTS
Dec 14, 2022: Manhattan, NYC: Pulsar + Pinot Meetup
[https://www.meetup.com/new-york-city-apache-pulsar-meetup/events/289817171/](https://www.meetup.com/new-york-city-apache-pulsar-meetup/events/289817171/)
Dec 15, 2022: TigerLabs, Princeton, NJ: Pulsar + NiFi + Flink Meetup
[https://www.meetup.com/new-york-city-apache-pulsar-meetup/events/289674210/](https://www.meetup.com/new-york-city-apache-pulsar-meetup/events/289674210/)
Data Science Camp Online
[https://dscamp.org/](https://dscamp.org/)
Feb 15, 2023: Scylla Summit. Virtual
[https://www.scylladb.com/scylladb-summit-2023/](https://www.scylladb.com/scylladb-summit-2023/)
**HTAP Summit**
Coming soon.
**Pinot / Pulsar Meetup**
Coming soon.
**CockroachDB NYC Meetup**
**Hazelcast Event**
[https://docs.hazelcast.com/hazelcast/5.1/integrate/pulsar-connector](https://docs.hazelcast.com/hazelcast/5.1/integrate/pulsar-connector)
### TOOLS
* [https://bret.dk/pi-zero-showdown/](https://bret.dk/pi-zero-showdown/)
* [https://mangopi.org/mangopi_mqpro](https://mangopi.org/mangopi_mqpro)
* [https://github.com/ananthdurai/schemata](https://github.com/ananthdurai/schemata)
* [https://github.com/mattkrick/trebuchet-client](https://github.com/mattkrick/trebuchet-client)
* [https://archive.ph/2022.12.07-180110/https://git.herrbischoff.com/awesome-macos-command-line/about/](https://archive.ph/2022.12.07-180110/https://git.herrbischoff.com/awesome-macos-command-line/about/)
* [https://marketplace.visualstudio.com/items?itemName=chunkypixel.atari-dev-studio](https://marketplace.visualstudio.com/items?itemName=chunkypixel.atari-dev-studio)
* [https://github.com/max-sixty/aoc-gpt](https://github.com/max-sixty/aoc-gpt)
* [https://github.com/willmcgugan/faqtory](https://github.com/willmcgugan/faqtory)
* [https://github.com/daochenzha/dreamshard](https://github.com/daochenzha/dreamshard)
* [https://www.githubtrends.io/](https://www.githubtrends.io/)
* [https://github.com/monoid-privacy/monoid](https://github.com/monoid-privacy/monoid)
* [https://github.com/RomanHotsiy/commitgpt](https://github.com/RomanHotsiy/commitgpt)
* [https://github.com/ehmicky/modern-errors](https://github.com/ehmicky/modern-errors)
* [https://github.com/wong2/chat-gpt-google-extension](https://github.com/wong2/chat-gpt-google-extension)
* [https://www.warp.dev/](https://www.warp.dev/)
* [https://github.com/niedzielski/cb](https://github.com/niedzielski/cb)
* [https://seatunnel.apache.org/docs/connector-v2/source/pulsar](https://seatunnel.apache.org/docs/connector-v2/source/pulsar)
* [https://github.com/facebook/prophet](https://github.com/facebook/prophet)
* [https://github.com/albfan/miraclecast](https://github.com/albfan/miraclecast)
* [A Hackable text editor](https://pulsar-edit.dev/)
#### TIPS
`
```
docker exec -it pulsar bin/pulsar-admin topics get-retention persistent://public/default/items
```
`
Another tip is don't run ChatGPT created functions on a cluster.
#### JOBS
[https://jobs.lever.co/stream-native/74d75fc1-1ad7-40a0-b907-66d8ac86009a](https://jobs.lever.co/stream-native/74d75fc1-1ad7-40a0-b907-66d8ac86009a)
Top comments (0)