nayag.com
robots.txt

Robots Exclusion Standard data for nayag.com

Resource Scan

Scan Details

Site Domain nayag.com
Base Domain nayag.com
Scan Status Ok
Last Scan2024-09-30T23:44:11+00:00
Next Scan 2024-10-07T23:44:11+00:00

Last Scan

Scanned2024-09-30T23:44:11+00:00
URL https://nayag.com/robots.txt
Domain IPs 104.21.27.119, 172.67.169.68, 2606:4700:3031::6815:1b77, 2606:4700:3035::ac43:a944
Response IP 172.67.169.68
Found Yes
Hash af181ac57a2b53917feab7b6248f21ab8ae437323a3d24189d2c4bfceab8afdb
SimHash 2141cb574abc

Groups

*

Rule Path
Disallow /cgi-bin/
Disallow /wp-admin/
Disallow /archives/
Disallow /*?deal=
Disallow /*?s=
Disallow /*wpid
Disallow /*?attachment_id=
Disallow /comments/feed/
Disallow /xmlrpc.php
Disallow /comments/feed/
Allow /wp-admin/admin-ajax.php

mediapartners-google*

Rule Path
Allow /

ninjabot

Rule Path
Allow /

googlebot-image

Rule Path
Allow /wp-content/uploads/
Disallow /*.pdf$
Disallow /*wpid
Disallow /*?attachment_id=

adsbot-google

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

googlebot

Rule Path
Allow .js
Allow .css

Other Records

Field Value
sitemap https://nayag.com/sitemap_index.xml

Comments

  • disallow all files in these directories