panantionline.it
robots.txt

Robots Exclusion Standard data for panantionline.it

Resource Scan

Scan Details

Site Domain panantionline.it
Base Domain panantionline.it
Scan Status Ok
Last Scan6/1/2025, 12:26:35 PM
Next Scan 7/1/2025, 12:26:35 PM

Last Scan

Scanned6/1/2025, 12:26:35 PM
URL https://panantionline.it/robots.txt
Redirect https://www.panantionline.it/robots.txt
Redirect Domain www.panantionline.it
Redirect Base panantionline.it
Domain IPs 104.21.29.58, 172.67.171.100, 2606:4700:3033::6815:1d3a, 2606:4700:3033::ac43:ab64
Redirect IPs 104.21.29.58, 172.67.171.100, 2606:4700:3033::6815:1d3a, 2606:4700:3033::ac43:ab64
Response IP 104.21.29.58
Found Yes
Hash ff899943c7dd3e9a0b46999433a4099a02aacb5df0d1b5170db766dc5eb87035
SimHash d4fcb49c6f94

Groups

*

Rule Path
Disallow /admin/
Disallow /myasg/
Disallow /include/asta-tempo/
Disallow /it/controller.asp
Disallow /uk/controller.asp
Disallow /it/controller-v2.asp
Disallow /uk/controller-v2.asp
Disallow /it/my-panel/*
Disallow /uk/my-panel/*
Disallow /it/my-panel/make-bid.asp
Disallow /uk/my-panel/make-bid.asp
Disallow /it/my-panel/pref-lot.asp
Disallow /uk/my-panel/pref-lot.asp
Disallow /uk/my-panel/condition-report.asp
Disallow /it/my-panel/condition-report.asp
Disallow /it/contatti/richiedi-informazioni.asp*?*
Disallow /uk/contacts/request-information.asp*?*
Disallow /it/contatti/richiedi-informazioni.asp?req=*
Disallow /uk/contacts/request-information.asp?req=*
Disallow /include/comuni*
Disallow /thumb/
Disallow *campoRicerca%3D*
Disallow *mlview%3D*
Disallow /cdn-cgi/*

ia_archiver

Product Comment
ia_archiver web.archive.org
Rule Path
Disallow /

amazonbot

Product Comment
amazonbot Amazon's user agent
Rule Path
Disallow /

dataforseobot

Product Comment
dataforseobot DataForSeoBot user agent
Rule Path
Disallow /

petalbot

Product Comment
petalbot PetalBot user agent
Rule Path
Disallow /

ahrefsbot

Product Comment
ahrefsbot AhrefsBot user agent
Rule Path
Disallow /

mj12bot

Product Comment
mj12bot MJ12bot user agent
Rule Path
Disallow /

megaindex.ru

Product Comment
megaindex.ru MegaIndex.ru user agent
Rule Path
Disallow /

serpstatbot

Product Comment
serpstatbot serpstatbot user agent
Rule Path
Disallow /

barkrowler

Product Comment
barkrowler Barkrowler user agent
Rule Path
Disallow /

seokicks

Product Comment
seokicks SEOkicks user agent
Rule Path
Disallow /

rainbot

Product Comment
rainbot RainBot user agent
Rule Path
Disallow /

test-bot

Product Comment
test-bot test-bot user agent
Rule Path
Disallow /

my-tiny-bot

Product Comment
my-tiny-bot my-tiny-bot user agent
Rule Path
Disallow /

fidget-spinner-bot

Product Comment
fidget-spinner-bot fidget-spinner-bot user agent
Rule Path
Disallow /