December 12-13, 2023
San Jose, CA
View More Details & Registration

The Sched app allows you to build your schedule but is not a substitute for your event registration. You must be registered for AI.dev & Cassandra Summit to participate in the sessions. If you have not registered but would like to join us, please go to the event registration page to purchase a registration.

This schedule is automatically displayed in Pacific Standard Time (UTC -8). To see the schedule in your preferred timezone, please select from the drop-down menu to the right, above "Filter by Date."
Tuesday, December 12 • 11:10am - 12:20pm
Workshop: Log Processing with Apache NiFi and Apache Kafka - Sophia Izokun, IBM

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!

Feedback form is now closed.

This session will be a technical workshop to demonstrate how to leverage open source tools (NiFi & Kafka) in real time log processing. The process of ingesting, indexing and assessing information from one or more events captured from a computing system is known as log analytics, most if not all "computers" and programmable software produce logs and the log dataset that will be used for this workshop is the NASA Kennedy Space Center Logs (from a web server located in florida).
The workshop will cover the following:
- How to set up the environment
- Data transformation
- Creating a Kafka Topic and NiFi Flow
- Setting up dataflow to get data from NiFi to Kafka Topic
- Loading data from Kafka topic into OpenSearch (OpenSearch is a perfect open source tool for log analytics)

avatar for Sophia Izokun

Sophia Izokun

Data Scientist, IBM
Sophia Izokun is a Data Scientist within CISO at IBM, she has 2.5. years experience in data science and analytics and also holds an MSc degree in Data Science from Middlesex University (UK). She's proficient in Python, Java, and R as well as data engineering techniques. As part of... Read More →

Tuesday December 12, 2023 11:10am - 12:20pm PST
LL21D (Lower Lobby Level)
  AI.dev: Data Engineering + Management
  • Audience Experience Level Advanced
  • Slides Attached Yes