moneyminiblog.com
robots.txt

Robots Exclusion Standard data for moneyminiblog.com

Resource Scan

Scan Details

Site Domain moneyminiblog.com
Base Domain moneyminiblog.com
Scan Status Ok
Last Scan2024-10-02T20:27:16+00:00
Next Scan 2024-10-09T20:27:16+00:00

Last Scan

Scanned2024-10-02T20:27:16+00:00
URL https://moneyminiblog.com/robots.txt
Domain IPs 34.149.120.3, 34.149.36.179, 34.160.81.203, 35.190.31.54
Response IP 34.160.17.71
Found Yes
Hash d03caa32311651860a48f9fc9ec0cfbe2f26d242d5af7f7d427847ddac0aa5d2
SimHash 6809da120bb2

Groups

scrapy

Rule Path
Allow /

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Allow /

Other Records

Field Value
sitemap https://moneyminiblog.com/sitemap_index.xml
sitemap https://moneyminiblog.com/sitemap.xml