adboom.it
robots.txt

Robots Exclusion Standard data for adboom.it

Resource Scan

Scan Details

Site Domain adboom.it
Base Domain adboom.it
Scan Status Ok
Last Scan2024-11-16T07:13:58+00:00
Next Scan 2024-11-23T07:13:58+00:00

Last Scan

Scanned2024-11-16T07:13:58+00:00
URL https://adboom.it/robots.txt
Domain IPs 104.21.38.34, 172.67.218.78, 2606:4700:3032::6815:2622, 2606:4700:3037::ac43:da4e
Response IP 172.67.218.78
Found Yes
Hash ed65383a166f4b8186930b925b19233cb8593e614e633b8ad2de996dd40fad61
SimHash 63585d904f9d

Groups

amazonbot

Rule Path
Disallow /adimages/
Disallow /tag/

Other Records

Field Value
crawl-delay 30

amazonbot/0.1

Rule Path
Disallow /adimages/
Disallow /tag/

semrushbot

Rule Path
Disallow /adimages/
Disallow /tag/

semrushbot/7~bl

Rule Path
Disallow /adimages/
Disallow /tag/

ahrefsbot

Rule Path
Disallow /adimages/
Disallow /tag/

ense.it

Rule Path
Disallow /

*

Rule Path
Disallow /imgnl.php
Disallow /tag
Allow /

Other Records

Field Value
crawl-delay 21

Other Records

Field Value
sitemap http://www.adboom.it/rss/sitemapindex.xml

Comments

  • 10.23.2024
  • It is expressively forbidden to use search robots or other automatic methods
  • to access adboom.it. Only if Adboom.it has given such permission can be accepted.