Dec 12, 2022 FLiP Stack Weekly

SEE:

People are FLiPN out about https://chat.openai.com/chat. It is a game changer, add another few years and this should be 10x better.

ChatGPT wrote me this Pulsar function:

import org.apache.pulsar.functions.api.Context;
import org.apache.pulsar.functions.api.Function;

public class BertQAFunction implements Function<String, String> {

  @Override
  public String process(String input, Context context) {
    // Parse the input JSON into a Java object using a JSON library
    // such as Jackson or Gson
    MyJsonObject json = parseJson(input);

    // Use the Bert QA library to perform QA on the JSON object
    BertQAResult result = BertQA.runQA(json);

    // Return the result as a JSON string
    return result.toJson();
  }

}

I then tried to build 50 more. Some are good, some are minimal, some are bad and some are just shells. An interesting start and some good ideas on functions to build. I offer the source as a starter for anyone wanting to build some functions.

https://github.com/tspannhw/pulsar-chatgptgenerated-functions

Check out our channel:

https://www.youtube.com/@streamnativecommunity8124/featured

New Stuff

https://cwiki.apache.org/confluence/display/NIFI/Release+Notes#ReleaseNotes-Version1.19.0

A quick preview of Apache Pulsar + Apache Pinot.

PODCAST

Take a look at recent podcasts in audio or video format.

CODE + COMMUNITY

Join my meetup group NJ/NYC/Philly/Virtual. We will have a hybrid event on December 8th.

This is Issue #62!!

VIDEOS

 Collect them all - Pulsar Summit Videos

• https://www.youtube.com/watch?v=v7qYBQVFz_k
• https://www.youtube.com/watch?v=txidgG7xcYE
• https://www.youtube.com/watch?v=wNkdH1A7C_s

ARTICLES

https://www.infoq.com/articles/serverless-websockets-realtime-messaging/

https://ververica.zendesk.com/hc/en-us/articles/6824103650076-How-to-Integrate-Ververica-Platform-with-Apache-Pulsar

https://blogs.oracle.com/java/post/go-native-with-spring-boot-3-and-graalvm

https://medium.com/@nifi.notes/building-an-effective-nifi-flow-queryrecord-cca5ba51afd5

https://medium.com/@nifi.notes/building-an-effective-nifi-flow-b5aa1b816380

http://funnifi.blogspot.com/2022/12/using-updatedatabaserecord-for-schema.html

https://vinodhini-sd.medium.com/what-is-chatgpt-is-it-really-coming-for-your-job-why-should-you-care-3dd6bfe74339

https://www.infoq.com/news/2022/10/apache-inlong-framework/

https://www.infoq.com/articles/streaming-first-real-time-ml/

https://www.infoq.com/presentations/ml-continuous-learning/

https://dev.to/hs/micronaut-pulsar-6bo

https://nakedsecurity.sophos.com/2022/12/08/credit-card-skimming-the-long-and-winding-road-of-supply-chain-failure/

https://blog.rockthejvm.com/pulsar-flink/

https://dzone.com/articles/how-to-choose-the-right-messaging-system-for-your

https://pulsar.apache.org/docs/2.10.x/cookbooks-non-persistent/

https://towardsdatascience.com/whats-next-for-data-engineering-in-2023-7-predictions-b57e3c1bf2d3

TRAINING

Dates are January 17 - 19, 2023 from 2pm - 5pm CET / 8am - 12pm EST Link to register: https://www.eventbrite.com/e/465055021087

https://streamnative.io/training/

CODE

https://github.com/tspannhw/pulsar-csp-ce

https://github.com/tspannhw/pulsar-thermal-pinot

https://github.com/tspannhw/create-nifi-pulsar-flink-apps

https://github.com/flipkart-incubator/pulsar-weighted-consumer

https://docs.dapr.io/reference/components-reference/supported-pubsub/setup-pulsar/

https://github.com/micronaut-projects/micronaut-pulsar/tree/master/examples/full-java-example

EVENTS

Dec 14, 2022: Manhattan, NYC: Pulsar + Pinot Meetup

Dec 15, 2022: TigerLabs, Princeton, NJ: Pulsar + NiFi + Flink Meetup

Jan 2023: Data Science Camp Online https://dscamp.org/

Feb 15, 2023: Scylla Summit. Virtual

HTAP Summit

Coming soon.

Pinot / Pulsar Meetup

Coming soon.

CockroachDB NYC Meetup

Hazelcast Event

https://docs.hazelcast.com/hazelcast/5.1/integrate/pulsar-connector

TOOLS

• https://bret.dk/pi-zero-showdown/
• https://mangopi.org/mangopi_mqpro
• https://github.com/ananthdurai/schemata
• https://github.com/mattkrick/trebuchet-client
• https://archive.ph/2022.12.07-180110/https://git.herrbischoff.com/awesome-macos-command-line/about/
• https://marketplace.visualstudio.com/items?itemName=chunkypixel.atari-dev-studio
• https://github.com/max-sixty/aoc-gpt
• https://github.com/willmcgugan/faqtory
• https://github.com/daochenzha/dreamshard
• https://www.githubtrends.io/
• https://github.com/monoid-privacy/monoid
• https://github.com/RomanHotsiy/commitgpt
• https://github.com/ehmicky/modern-errors
• https://github.com/wong2/chat-gpt-google-extension
• https://www.warp.dev/
• https://github.com/niedzielski/cb
• https://seatunnel.apache.org/docs/connector-v2/source/pulsar
• https://github.com/facebook/prophet
• https://github.com/albfan/miraclecast
• A Hackable text editor

TIPS

docker exec -it pulsar bin/pulsar-admin topics get-retention persistent://public/default/items

Another tip is don't run ChatGPT created functions on a cluster.

JOBS

https://jobs.lever.co/stream-native/74d75fc1-1ad7-40a0-b907-66d8ac86009a