Skip to content

Latest commit

 

History

History
16 lines (13 loc) · 675 Bytes

README.md

File metadata and controls

16 lines (13 loc) · 675 Bytes

Tools Contained in this Repository

  • kafka-filter-pypi: Consumes PyPI packaging information in the Warehouse format from a kafka topic and produces unique package-version tuples into another kafka topic.
  • cg-producer: Consumes PyPI packaging information from a kafka topic and produces call graphs into another kafka topic.

Pipeline

  1. Use kafka-filter-pypi to extract useful PyPI packaging information to an output topic.
  2. Use the kafka-filter-pypi output topic as an input topic for cg-producer in order to generate the call graphs of the packages identified.