marathimaaj.com
robots.txt

Robots Exclusion Standard data for marathimaaj.com

Resource Scan

Scan Details

Site Domain marathimaaj.com
Base Domain marathimaaj.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-09-28T08:08:10+00:00
Next Scan 2024-11-27T08:08:10+00:00

Last Successful Scan

Scanned2024-07-31T08:05:53+00:00
URL https://marathimaaj.com/robots.txt
Domain IPs 128.199.16.124
Response IP 128.199.16.124
Found Yes
Hash 2479a1e421faf6c0857984c64c22370a1cfb4ee9ec511e2da4fa7c0439ed1305
SimHash 63114b8ae293

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /?s=*
Disallow /search/*
Disallow /cgi-bin/
Disallow /comments/feed/
Disallow /trackback/
Disallow /index.php
Disallow /xmlrpc.php
Disallow /wp-content/plugins/*

ninjabot

Rule Path
Allow /

mediapartners-google*

Rule Path
Allow /

googlebot-image

Rule Path
Allow /wp-content/uploads/

adsbot-google

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

Other Records

Field Value
sitemap https://marathimaaj.com/sitemap_index.xml