spelling.com
robots.txt

Robots Exclusion Standard data for spelling.com

Resource Scan

Scan Details

Site Domain spelling.com
Base Domain spelling.com
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-09-07T04:40:00+00:00
Next Scan 2024-12-06T04:40:00+00:00

Last Successful Scan

Scanned2022-11-11T20:17:12+00:00
URL http://spelling.com/robots.txt
Redirect https://www.dictionary.com/robots.txt
Redirect Domain www.dictionary.com
Redirect Base dictionary.com
Response IP 151.101.2.133, 151.101.66.133, 151.101.130.133, 151.101.194.133
Found Yes
Hash 3b4947fb9ae4a3f0464bb86a475d4497c979f9d5529a149497a4b575f431f404
SimHash 0a419a10c3b3

Groups

deepcrawl

Rule Path
Disallow /

seerbot/1.0

Rule Path
Disallow /

*

Rule Path
Disallow /5480.iac.
Disallow /go/
Disallow /audio.html/
Disallow /houseads/
Disallow /askhome/
Disallow /23219321/iac.
Disallow /*%2C*
Allow /

Other Records

Field Value
sitemap https://www.dictionary.com/dictionary-sitemap/sitemap.xml
sitemap https://www.dictionary.com/e/sitemap_index.xml