BBOT 3.0 - blazed_elijah

[TheTechromancer]

Summary

BBOT 3.0 "blazed_elijah" contains changes needed to store BBOT data in a persistent database. The idea is to release it alongside BBOT server, a tiny CLI-only database. This will be paired with a series of blog posts showing how BBOT server can be used on the command line to script out bug bounty hunting, threat intel, and ASM (i.e. running scheduled scans, exporting to CSV, diffing results over time, etc.).

Together, BBOT 3.0 and BBOT server will give us a solid foundation to build a bunch of other useful tooling, like asset inventory. Sometime in the future, it may also be useful to frontend.

Breaking changes

The main breaking change in BBOT 3.0 is that the name of the .data field is different based on whether it's a str or dict.

• .data: string
• .data_json: dictionary

The siem_friendly option has been removed, since BBOT data is now SIEM-friendly by default.

Features

• New Module: MongoDB Output #1992
• New Module: Elastic Output #2010
• New Module: RabbitMQ Output #2013
• New Module: Kafka Output #2011
• New Module: ZeroMQ Output #2015
• New Module: NATS Output #2017

Potential changes

• Can "internal" and "omitted" events be merged? #1592

[codecov]

Codecov Report

Attention: Patch coverage is 94.92481% with 27 lines in your changes missing coverage. Please review.

Project coverage is 93%. Comparing base (8ed0708) to head (bb86fb6).

Files with missing lines	Patch %	Lines
bbot/models/pydantic.py	92%	6 Missing ⚠️
bbot/core/event/base.py	75%	5 Missing ⚠️
bbot/modules/output/mongo.py	91%	5 Missing ⚠️
bbot/modules/output/kafka.py	90%	3 Missing ⚠️
bbot/modules/output/rabbitmq.py	90%	3 Missing ⚠️
...test/test_step_2/module_tests/test_module_mongo.py	96%	3 Missing ⚠️
bbot/models/sql.py	82%	2 Missing ⚠️

Additional details and impacted files

@@          Coverage Diff           @@
##             dev   #2007    +/-   ##
======================================
+ Coverage     93%     93%    +1%     
======================================
  Files        374     385    +11     
  Lines      28492   28919   +427     
======================================
+ Hits       26289   26694   +405     
- Misses      2203    2225    +22     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.