timexmetals.com
robots.txt

Robots Exclusion Standard data for timexmetals.com

Resource Scan

Scan Details

Site Domain timexmetals.com
Base Domain timexmetals.com
Scan Status Ok
Last Scan2025-04-06T00:54:03+00:00
Next Scan 2025-05-06T00:54:03+00:00

Last Scan

Scanned2025-04-06T00:54:03+00:00
URL https://timexmetals.com/robots.txt
Domain IPs 2a02:4780:16:c4bd:e741:b6f9:d037:4579, 84.32.84.94
Response IP 77.37.66.215
Found Yes
Hash ec9cbf157e7230dd0ef0c04d9aae263666f6c62e896c58bdb71f9b599b8e44e6
SimHash 8d1d90e04f31

Groups

*

Rule Path
Allow /sitemap.xml

flashget

Rule Path
Disallow /

offline

Rule Path
Disallow /

teleport

Rule Path
Disallow /

downloader

Rule Path
Disallow /

reaper

Rule Path
Disallow /

webzip

Rule Path
Disallow /

website quester

Rule Path
Disallow /

fast-webcrawler

Rule Path
Disallow /

gulliver

Rule Path
Disallow /

webcapture

Rule Path
Disallow /

httrack

Rule Path
Disallow /

fetch api request

Rule Path
Disallow /

netants

Rule Path
Disallow /

superbot

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

wget

Rule Path
Disallow /

emailsiphon

Rule Path
Disallow /

msproxy/2.0

Rule Path
Disallow /

emailwolf

Rule Path
Disallow /

webbandit

Rule Path
Disallow /

ms frontpage

Rule Path
Disallow /

Other Records

Field Value
sitemap https://timexmetals.com/sitemap.xml