Getting Started with Apache Pulsar™

Difficulty: Beginner

Estimated Time: 15 minutes

In this scenario, you will:

Install, configure and start Apache Pulsar™
Create a new topic using pulsar-admin
Create a consumer using pulsar-client
Create a producer using pulsar-client
Use Apache Pulsar™ for pub/sub messaging

Check out our datastax.com/dev site, where you can find many more resources to help you succeed with Apache Cassandra™.

In this scenario, you learned how to:

Install, configure and start Apache Pulsar™
Create a new topic using pulsar-admin
Create a consumer using pulsar-client
Create a producer using pulsar-client
Use Apache Pulsar™ for pub/sub messaging

Your environment is currently being packaged as a Docker container and the download will begin shortly. To run the image locally, once Docker has been installed, use the commands

cat scrapbook_datastax_pulsar/install-and-run_container.tar | docker load

docker run -it /datastax_pulsar/install-and-run:

Restart Scenario

Next Scenario

Step 1 of 7

Install Apache Pulsar™

Download the tarball:

wget https://downloads.apache.org/pulsar/pulsar-2.7.2/apache-pulsar-2.7.2-bin.tar.gz

Untar the tarball and navigate to the Pulsar directory:

tar xvfz apache-pulsar-2.7.2-bin.tar.gz
cd apache-pulsar-2.7.2

Run Apache Pulsar™

List the command-line tools in the bin directory:

ls bin

This particular scenario uses pulsar, pulsar-admin and pulsar-client.

Start a local cluster using the pulsar command:

bin/pulsar standalone

If Apache Pulsar™ starts successfully, there will be a number of INFO-level log messages displayed.

Use pulsar-admin to learn about the cluster, tenants, namespaces and topics

Navigate to the Pulsar directory in Admin Terminal:

cd apache-pulsar-2.7.2

Display the cluster name:

bin/pulsar-admin clusters list

Display the tenants:

bin/pulsar-admin tenants list

Display the namespaces in the public tenant:

bin/pulsar-admin namespaces list public

Display the topics in the public/default namespace:

bin/pulsar-admin topics list public/default

Since there are no topics in the public/default namespace, let's create one next.

Use pulsar-admin to create a new topic

Create topic shakespeare-quotes in the public/default namespace:

bin/pulsar-admin topics create persistent://public/default/shakespeare-quotes

Display the topics in the public/default namespace:

bin/pulsar-admin topics list public/default

Use pulsar-client to create a consumer that receives messages

Navigate to the Pulsar directory in Consumer Terminal:

cd apache-pulsar-2.7.2

Subscribe a consuming client, consumer, to the new topic public/default/shakespeare-quotes using the pulsar-client tool:

bin/pulsar-client consume public/default/shakespeare-quotes -s "my-shakespeare-subscription"

Let's publish a message into this topic next.

Use pulsar-client to create a producer that sends messages

Navigate to the Pulsar directory in Producer Terminal:

cd apache-pulsar-2.7.2

Create a producing client, producer, and send a message to the public/default/shakespeare-quotes topic using the pulsar-client tool:

bin/pulsar-client produce public/default/shakespeare-quotes -m "Brevity is the soul of wit"

The output should read 1 messages successfully produced.

Switch to Consumer Terminal and verify that the message was received by the consumer:

echo "Go to Consumer Terminal ..."

Look for output pieces ----- got message -----, content:Brevity is the soul of wit and 1 messages successfully consumed.

Send and receive more messages

In Producer Terminal, send 60 messages at the rate of 1 message per second:

bin/pulsar-client produce public/default/shakespeare-quotes \
-m \
"All that glitters is not gold"~"Fair is foul, and foul is fair: Hover through the fog and filthy air."~"Hell is empty and all the devils are here."~"By the pricking of my thumbs, Something wicked this way comes. Open, locks, Whoever knocks!"~"The lady doth protest too much, methinks."~"Brevity is the soul of wit."~"These violent delights have violent ends..."~"Now is the winter of our discontent."~"If music be the food of love, play on."~"Good night, good night! parting is such sweet sorrow, That I shall say good night till it be morrow." \
-n 6 -r 1 -s "~"

In Consumer Terminal, receive the 60 messages at the same rate of 1 message per second:

bin/pulsar-client consume public/default/shakespeare-quotes -s "my-shakespeare-subscription" -n 60 -r 1

Terminal

Admin Terminal

Consumer Terminal

Producer Terminal

cd <directory>	Change directory
ls	List directory
echo 'contents' > <file>	Write contents to a file
cat <file>	Output contents of file

i	In Command Mode	Change into Insert Mode, you can now insert and edit text in the file
esc	In Insert Mode	Change into Command Mode, you can now execute commands
:wq	In Command Mode	Save and Exit

Welcome!

Getting Started with Apache Pulsar™

Congratulations!

You've completed the scenario!

Scenario Rating

Steps