scanbacklinks.com
robots.txt

Robots Exclusion Standard data for scanbacklinks.com

Resource Scan

Scan Details

Site Domain scanbacklinks.com
Base Domain scanbacklinks.com
Scan Status Ok
Last Scan2025-10-10T16:57:55+00:00
Next Scan 2025-11-09T16:57:55+00:00

Last Scan

Scanned2025-10-10T16:57:55+00:00
URL https://scanbacklinks.com/robots.txt
Domain IPs 104.21.88.17, 172.67.150.34, 2606:4700:3031::ac43:9622, 2606:4700:3035::6815:5811
Response IP 104.21.88.17
Found Yes
Hash d93e9fd1cbe5beda645d3e1e2d49741b3f6d265807f22de27aecd4d2d3d151fb
SimHash 137155d3cf0a

Groups

etaospider

Rule Path
Disallow /

nutch

Rule Path
Disallow /

larbin

Rule Path
Disallow /

heritrix

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

*

Rule Path
Disallow /admin*
Disallow /go/
Disallow /*?url=*
Disallow */contact*
Disallow */contact_us_thanks*
Disallow */sb-rank-result*
Disallow */dapa-result*
Disallow */sb-rank-result*
Disallow */tos*
Disallow */libre-forms/*
Disallow */keywordreport/*
Disallow */imagealtreport/*
Disallow */brokenlinkreport/*
Disallow */export-csv/*
Disallow */noresult*
Disallow */export-xlsx*

Other Records

Field Value
sitemap https://scanbacklinks.com/sitemap.xml