moneyminiblog.com
robots.txt

Robots Exclusion Standard data for moneyminiblog.com

Resource Scan

Scan Details

Site Domain moneyminiblog.com
Base Domain moneyminiblog.com
Scan Status Ok
Last Scan2024-11-13T20:34:29+00:00
Next Scan 2024-11-20T20:34:29+00:00

Last Scan

Scanned2024-11-13T20:34:29+00:00
URL https://moneyminiblog.com/robots.txt
Domain IPs 34.120.190.48, 34.149.120.3, 35.190.31.54, 35.227.194.51
Response IP 34.160.81.203
Found Yes
Hash d03caa32311651860a48f9fc9ec0cfbe2f26d242d5af7f7d427847ddac0aa5d2
SimHash 6809da120bb2

Groups

scrapy

Rule Path
Allow /

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Allow /

Other Records

Field Value
sitemap https://moneyminiblog.com/sitemap_index.xml
sitemap https://moneyminiblog.com/sitemap.xml