scrap-recycle.com
robots.txt

Robots Exclusion Standard data for scrap-recycle.com

Resource Scan

Scan Details

Site Domain scrap-recycle.com
Base Domain scrap-recycle.com
Scan Status Ok
Last Scan2025-11-26T09:48:47+00:00
Next Scan 2025-12-03T09:48:47+00:00

Last Scan

Scanned2025-11-26T09:48:47+00:00
URL https://scrap-recycle.com/robots.txt
Domain IPs 162.43.94.32
Response IP 162.43.94.32
Found Yes
Hash 08835e07c60a79f772304561b558302a24e3ee1281cde9263ca98243bc8d2291
SimHash 971d5897e952

Groups

cutestat

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

adsbot

Rule Path
Disallow /

dataprovider

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://scrap-recycle.com/sitemap.php