Scan engine optimization

hidden ⚙ Improved

We have made significant improvements to the scanner's target queue. We have reduced the timeout to 300 ms for invalid domains or email addresses, so they no longer cause delays for other scans. Additionally, we have added indexes to the database collections to speed up data processing. To save time and server traffic, we have also included projections that retrieve only the necessary fields from a document, rather than all fields. retrieve only the necessary fields from a document, rather than all fields.

Andrea Toponi

1 year ago

Activity
Andrea Toponi changed status to ⚙ Improved

1 year ago

No votes yet
Categories
Backend/Stability