wordfinder.yourdictionary.com
robots.txt

Robots Exclusion Standard data for wordfinder.yourdictionary.com

Resource Scan

Scan Details

Site Domain wordfinder.yourdictionary.com
Base Domain yourdictionary.com
Scan Status Ok
Last Scan2024-06-01T06:22:54+00:00
Next Scan 2024-06-08T06:22:54+00:00

Last Scan

Scanned2024-06-01T06:22:54+00:00
URL https://wordfinder.yourdictionary.com/robots.txt
Domain IPs 13.33.88.13, 13.33.88.3, 13.33.88.6, 13.33.88.87, 2600:9000:223b:1200:4:29a6:d480:93a1, 2600:9000:223b:3800:4:29a6:d480:93a1, 2600:9000:223b:8a00:4:29a6:d480:93a1, 2600:9000:223b:8c00:4:29a6:d480:93a1, 2600:9000:223b:a00:4:29a6:d480:93a1, 2600:9000:223b:f600:4:29a6:d480:93a1, 2600:9000:223b:f800:4:29a6:d480:93a1, 2600:9000:223b:fe00:4:29a6:d480:93a1
Response IP 13.33.88.6
Found Yes
Hash 98767202840467d42583561daaadcafdcdf2c7be3f05402fe24850f29c13ba2b
SimHash 29058b42e7f3

Groups

*

Rule Path
Disallow /*?*
Disallow /app/get-the-app/
Allow /anagram-solver/$
Disallow /anagram-solver/*
Disallow /search*
Disallow /wordle/results*
Disallow /quordle/results*

adsbot-google-mobile

Rule Path
Disallow /

adsbot-google

Rule Path
Disallow /

Other Records

Field Value
sitemap https://wordfinder.yourdictionary.com/sitemap_index.xml

Comments

  • Block AdsBot crawling