abstract.com
robots.txt

Robots Exclusion Standard data for abstract.com

Resource Scan

Scan Details

Site Domain abstract.com
Base Domain abstract.com
Scan Status Ok
Last Scan2024-11-08T01:46:55+00:00
Next Scan 2024-12-08T01:46:55+00:00

Last Scan

Scanned2024-11-08T01:46:55+00:00
URL https://abstract.com/robots.txt
Redirect https://www.abstract.com/robots.txt
Redirect Domain www.abstract.com
Redirect Base abstract.com
Domain IPs 75.2.70.75, 99.83.190.102
Redirect IPs 52.197.0.54, 52.199.221.217, 54.178.223.218
Response IP 52.197.0.54
Found Yes
Hash a2e4ebdb171284d18fad8b1a0836f1819b88e1ef8c57cdb204f232c743dfa19a
SimHash ec2d4c044fd3

Groups

*

Rule Path
Disallow /*-archive/*
Disallow /2021-archive/*

Other Records

Field Value
sitemap https://www.abstract.com/sitemap.xml