au.ign.com
robots.txt

Robots Exclusion Standard data for au.ign.com

Resource Scan

Scan Details

Site Domain au.ign.com
Base Domain ign.com
Scan Status Ok
Last Scan2024-04-25T18:58:10+00:00
Next Scan 2024-05-02T18:58:10+00:00

Last Scan

Scanned2024-04-25T18:58:10+00:00
URL https://au.ign.com/robots.txt
Redirect https://www.ign.com/robots.txt
Redirect Domain www.ign.com
Redirect Base ign.com
Domain IPs 151.101.1.135, 151.101.129.135, 151.101.193.135, 151.101.65.135
Redirect IPs 151.101.1.135, 151.101.129.135, 151.101.193.135, 151.101.65.135
Response IP 199.232.45.135
Found Yes
Hash 73f681261e9909cc8d662f48c4ce928d5cf0a82c13388ae40b23662da38ef80e
SimHash 3e318a70ef82

Groups

*

Rule Path
Disallow /_views/
Disallow /apiproxy
Disallow */empty/
Disallow /beta
Disallow /blogs/
Disallow /debug
Disallow /pokedex/search
Disallow /search
Disallow /static/pv_candidate.html
Disallow /stf/
Disallow /sign-in
Disallow /sugarfif.html
Disallow /wikis/*/edit
Disallow /wikis/*/topcontributors

gptbot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

piplbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.ign.com/rss/news/sitemap
sitemap https://www.ign.com/rss/wikis/sitemap-ign-wiki-current
sitemap https://www.ign.com/rss/videos/sitemap-index-recently-updated
sitemap https://www.ign.com/rss/articles/sitemap-index-recently-updated