thefabricator.com
robots.txt

Robots Exclusion Standard data for thefabricator.com

Resource Scan

Scan Details

Site Domain thefabricator.com
Base Domain thefabricator.com
Scan Status Ok
Last Scan2024-10-29T19:25:50+00:00
Next Scan 2024-11-05T19:25:50+00:00

Last Scan

Scanned2024-10-29T19:25:50+00:00
URL https://thefabricator.com/robots.txt
Redirect https://www.thefabricator.com/robots.txt
Redirect Domain www.thefabricator.com
Redirect Base thefabricator.com
Domain IPs 104.26.10.147, 104.26.11.147, 172.67.72.155, 2606:4700:20::681a:a93, 2606:4700:20::681a:b93, 2606:4700:20::ac43:489b
Redirect IPs 104.26.10.147, 104.26.11.147, 172.67.72.155, 2606:4700:20::681a:a93, 2606:4700:20::681a:b93, 2606:4700:20::ac43:489b
Response IP 104.26.11.147
Found Yes
Hash 014a7ae79b80729212d4942348db0d4842ca213867ecba2759df85bae5922bc3
SimHash 6c250d00af92

Groups

*

Rule Path
Disallow /search
Disallow /directory/search

Other Records

Field Value
sitemap https://www.thefabricator.com/sitemap.xml