couponbirds.com
robots.txt

Robots Exclusion Standard data for couponbirds.com

Resource Scan

Scan Details

Site Domain couponbirds.com
Base Domain couponbirds.com
Scan Status Ok
Last Scan2024-05-18T13:52:06+00:00
Next Scan 2024-06-17T13:52:06+00:00

Last Scan

Scanned2024-05-18T13:52:06+00:00
URL https://couponbirds.com/robots.txt
Redirect https://www.couponbirds.com/robots.txt
Redirect Domain www.couponbirds.com
Redirect Base couponbirds.com
Domain IPs 104.18.12.221, 104.18.13.221
Redirect IPs 104.18.10.42, 104.18.11.42
Response IP 104.18.11.42
Found Yes
Hash 932835941cf7b20aadf37903ba445760a2c9093006aefb8f57c9f45bf24b5a97
SimHash db375981e531

Groups

*

Rule Path
Disallow /search/
Disallow /admin/
Disallow /Public/
Disallow /public/
Disallow /Libs/
Disallow /App/
Disallow /out/
Disallow /go/
Disallow /turn/
Disallow /list/*
Disallow /static/*
Disallow /Visitor/*

ia_archiver

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

ntentbot

Rule Path
Disallow /

admantx

Rule Path
Disallow /

proximic

Rule Path
Disallow /

spbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

domain re-animator bot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

fasterfox

Rule Path
Disallow /

caliperbot

Rule Path
Disallow /

screaming frog seo spider

Rule Path
Disallow /

sitebot

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

hubspot links crawler 1.0

Rule Path
Disallow /

hubspot links crawler 2.0

Rule Path
Disallow /

hubspot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

linespider

Rule Path
Disallow /

ias-va/3.1

Rule Path
Disallow /

applebot

Rule Path
Disallow /

Warnings

  • 2 invalid lines.