mungus.com
robots.txt

Robots Exclusion Standard data for mungus.com

Resource Scan

Scan Details

Site Domain mungus.com
Base Domain mungus.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-05-20T13:23:27+00:00
Next Scan 2024-08-18T13:23:27+00:00

Last Successful Scan

Scanned2023-04-03T18:22:04+00:00
URL https://mungus.com/robots.txt
Domain IPs 104.21.18.134, 172.67.181.222, 2606:4700:3032::ac43:b5de, 2606:4700:3033::6815:1286
Response IP 104.21.18.134
Found Yes
Hash 636cfab417ebc1d29dd5d33ce174f1e4158bcda1d4b16c8177ea3a4350bbe561
SimHash 6a8a5a314df1

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

googlebot

Rule Path
Allow /

storebot-google

Rule Path
Allow /

googlebot-image/1.0

Rule Path
Allow /

mediapartners-google

Rule Path
Allow /

googlebot-news

Rule Path
Allow /

bingbot

Rule Path
Allow /

slurp

Rule Path
Allow /

yandexbot

Rule Path
Allow /

facebot

Rule Path
Allow /

applebot

Rule Path
Allow /

yahoo! slurp

Rule Path
Allow /

twitterbot

Rule Path
Allow /

msnbot-media

Rule Path
Allow /

msnbot

Rule Path
Allow /

bingpreview

Rule Path
Allow /

Other Records

Field Value
sitemap https://mungus.com/sitemap_index.xml
sitemap https://mungus.com/post-sitemap.xml
sitemap https://mungus.com/page-sitemap.xml
sitemap https://mungus.com/blocks-sitemap.xml
sitemap https://mungus.com/product-sitemap.xml
sitemap https://mungus.com/category-sitemap.xml
sitemap https://mungus.com/post_tag-sitemap.xml
sitemap https://mungus.com/product_cat-sitemap.xml
sitemap https://mungus.com/product_tag-sitemap.xml
sitemap https://mungus.com/author-sitemap.xml