Log In Sign Up

pajakonline.com
robots.txt

Robots Exclusion Standard data for pajakonline.com

Resource Scan

Scan Details

Site Domain pajakonline.com
Base Domain pajakonline.com
Scan Status Ok
Last Scan2024-09-21T13:16:49+00:00
Next Scan 2024-09-28T13:16:49+00:00

Last Scan

Scanned2024-09-21T13:16:49+00:00
URL https://pajakonline.com/robots.txt
Redirect https://www.pajakonline.com/robots.txt
Redirect Domain www.pajakonline.com
Redirect Base pajakonline.com
Domain IPs 103.145.227.144
Redirect IPs 103.145.227.144
Response IP 103.145.227.144
Found Yes
Hash 460e32d88652e73974e2f0418021f3a0cbf19a4008cebeb0f8ff6327fdd1d32c
SimHash 6701dba35037

Groups

googlebot

Rule Path
Allow /

googlebot-image

Rule Path
Allow /wp-content/uploads/

mediapartners-google

Rule Path
Allow /

adsbot-google

Rule Path
Allow /

adsbot-google-mobile

Rule Path
Allow /

bingbot

Rule Path
Allow /

msnbot

Rule Path
Allow /

msnbot-media

Rule Path
Allow /wp-content/uploads/

applebot

Rule Path
Allow /

yandex

Rule Path
Allow /

yandeximages

Rule Path
Allow /wp-content/uploads/

slurp

Rule Path
Allow /

duckduckbot

Rule Path
Allow /

qwantify

Rule Path
Allow /

*

Rule Path
Allow /ads.txt

*

Rule Path
Allow /app-ads.txt

Other Records

Field Value
crawl-delay 5
Back to top

Comments

  • Allow/Disallow Ads.txt
  • Allow/Disallow App-ads.txt
  • User-agent: *
  • Disallow: /wp-admin/
  • Allow: /wp-admin/admin-ajax.php
  • Sitemap: https://www.pajakonline.com/sitemap.xml
  • Sitemap: https://www.pajakonline.com/sitemap.rss
  • This robots.txt file was created by Better Robots.txt (Index & Rank Booster by Pagup) Plugin. https://www.better-robots.com/
Back to top