A reliable crawler detection system must be established before triggering bandwidth-consumption mechanisms; otherwise, false positives affecting real users will result in catastrophic user experience.