moneyniti.com
robots.txt

Robots Exclusion Standard data for moneyniti.com

Resource Scan

Scan Details

Site Domain moneyniti.com
Base Domain moneyniti.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2024-09-30T06:26:44+00:00
Next Scan 2024-11-29T06:26:44+00:00

Last Successful Scan

Scanned2024-08-02T06:25:07+00:00
URL https://moneyniti.com/robots.txt
Domain IPs 104.21.81.191, 172.67.190.144, 2606:4700:3031::6815:51bf, 2606:4700:3035::ac43:be90
Response IP 172.67.190.144
Found Yes
Hash d07e5abcae20cb43c4def4194f904c5d5df80c01a3aa0917808c583f853199b9
SimHash 45bd5310a191

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /tag/
Disallow /category/
Disallow /expand_article/
Disallow /comment-page/
Disallow /cdn-cgi/
Disallow /beardeddragon/
Disallow /secure.gravatar/
Disallow /porpoiseant/
Disallow /detroitchicago/
Disallow /tardisrocinante/
Disallow /google_vignette/
Disallow /facebook.com/
Disallow /twitter.com/
Disallow /pinterest.com/
Disallow /linkedin.com/
Disallow /reddit.com/
Disallow /api.whatsapp.com/
Disallow /endpoint/
Disallow /apply/
Disallow /apply-now/
Disallow /apply-banner/
Disallow /apply-marketplace/
Disallow /search/
Disallow /*s%3D

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

Other Records

Field Value
sitemap https://moneyniti.com/sitemap.xml

Warnings

  • `noindex` is not a known field.