adsy.com
robots.txt

Robots Exclusion Standard data for adsy.com

Resource Scan

Scan Details

Site Domain adsy.com
Base Domain adsy.com
Scan Status Ok
Last Scan2024-09-13T16:22:03+00:00
Next Scan 2024-10-13T16:22:03+00:00

Last Scan

Scanned2024-09-13T16:22:03+00:00
URL https://adsy.com/robots.txt
Domain IPs 104.26.10.117, 104.26.11.117, 172.67.72.95, 2606:4700:20::681a:a75, 2606:4700:20::681a:b75, 2606:4700:20::ac43:485f
Response IP 172.67.72.95
Found Yes
Hash bda6d97465752d27314ad63e6ccbe08887c149a93be5758d09f34f47fe570afb
SimHash 08195c458552

Groups

etaospider

Rule Path
Disallow /

nutch

Rule Path
Disallow /

larbin

Rule Path
Disallow /

heritrix

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

*

Rule Path
Disallow /admin/site/login
Disallow /site/login
Disallow /thanks-marketer
Disallow /contact
Disallow /terms-and-conditions

Other Records

Field Value
sitemap https://adsy.com/sitemap.xml