beachcombertradingpostmk.com
robots.txt

Robots Exclusion Standard data for beachcombertradingpostmk.com

Resource Scan

Scan Details

Site Domain beachcombertradingpostmk.com
Base Domain beachcombertradingpostmk.com
Scan Status Ok
Last Scan2025-12-21T21:32:01+00:00
Next Scan 2026-01-04T21:32:01+00:00

Last Scan

Scanned2025-12-21T21:32:01+00:00
URL https://beachcombertradingpostmk.com/robots.txt
Domain IPs 162.159.140.177, 172.66.0.175, 2606:4700:7::af, 2a06:98c1:58::af
Response IP 162.159.140.177
Found Yes
Hash 699847c62fe61d5fb63774e7e71b286bb2da7d9ae012edfa2ca7a838a6c20a51
SimHash 4a08de11c792

Groups

*

Rule Path
Allow /
Disallow /internal/

semrushbot

Rule Path
Allow /
Disallow /internal/

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://beachcombertradingpostmk.com/sitemap.xml
sitemap https://beachcombertradingpostmk.com/sitemap.xml