thefashionwiki.com
robots.txt

Robots Exclusion Standard data for thefashionwiki.com

Resource Scan

Scan Details

Site Domain thefashionwiki.com
Base Domain thefashionwiki.com
Scan Status Ok
Last Scan2024-09-26T02:36:58+00:00
Next Scan 2024-09-27T02:36:58+00:00

Last Scan

Scanned2024-09-26T02:36:58+00:00
URL https://thefashionwiki.com/robots.txt
Domain IPs 104.21.36.60, 172.67.186.101, 2606:4700:3032::ac43:ba65, 2606:4700:3037::6815:243c
Response IP 104.21.36.60
Found Yes
Hash 3afbb70dce5f4b30c932388682425b1bbc2fc448ecef89b1a72ebdfb413b40cd
SimHash 0945db7567d1

Groups

*

Rule Path
Allow /

*

Rule Path
Disallow /

bingbot
googlebot
slurp

Rule Path
Allow /

*

Rule Path
Disallow /

bingbot
googlebot
slurp

Rule Path
Allow /

*

Rule Path
Disallow /

bingbot
googlebot
slurp

Rule Path
Allow /

Other Records

Field Value
sitemap https://thefashionwiki.com/sitemap.xml
sitemap https://thefashionwiki.com/?sitemap.xml
sitemap https://thefashionwiki.com/sitemap.xml.gz
sitemap https://thefashionwiki.com/?sitemap.xml.gz
sitemap https://thefashionwiki.com/post-sitemap.xml
sitemap https://8.222.200.107/post-sitemap.xml
sitemap https:///post-sitemap.xml