Log In Sign Up

digdougpowell.com
robots.txt

Robots Exclusion Standard data for digdougpowell.com

Resource Scan

Scan Details

Site Domain digdougpowell.com
Base Domain digdougpowell.com
Scan Status Ok
Last Scan2025-11-07T19:16:34+00:00
Next Scan 2025-12-07T19:16:34+00:00

Last Scan

Scanned2025-11-07T19:16:34+00:00
URL https://digdougpowell.com/robots.txt
Redirect https://www.digdougpowell.com/robots.txt
Redirect Domain www.digdougpowell.com
Redirect Base digdougpowell.com
Domain IPs 104.21.75.187, 172.67.180.135, 2606:4700:3031::6815:4bbb, 2606:4700:3032::ac43:b487
Redirect IPs 104.21.75.187, 172.67.180.135, 2606:4700:3031::6815:4bbb, 2606:4700:3032::ac43:b487
Response IP 104.21.75.187
Found Yes
Hash 1cf4a43330aa36dbf8356540dc55cbeacfe336c52b2d69d89b5c1faf9f377f43
SimHash 24003a53c683

Groups

googlebot

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

googlebot-mobile

Rule Path
Disallow

msnbot

Rule Path
Disallow

slurp

Rule Path
Disallow

teoma

Rule Path
Disallow

gigabot

Rule Path
Disallow

robozilla

Rule Path
Disallow

nutch

Rule Path
Disallow

ia_archiver

Rule Path
Disallow

baiduspider

Rule Path
Disallow

naverbot

Rule Path
Disallow

yeti

Rule Path
Disallow

yahoo-mmcrawler

Rule Path
Disallow

psbot

Rule Path
Disallow

yahoo-blogs/v3.9

Rule Path
Disallow

*

Rule Path Comment
Disallow /cgi-bin/ -
Disallow /private/ -
Disallow /tmp/ -
Disallow /admin/ Blocks crawlers from accessing sensitive areas
Disallow /login/ Blocks crawlers from accessing login pages
Disallow /checkout/ Blocks crawlers from accessing checkout page if needed
Allow /bali777 -
Allow /slot-gacor-bali777 -
Allow /promosi-bali777 -
Allow /game-terbaik-bali777 -
Allow /cara-daftar-bali777 -
Back to top

Other Records

Field Value
sitemap https://digdougpowell.com/sitemap.xml
Back to top

Comments

  • Robots.txt file for https://digdougpowell.com/
  • Optimize for quick indexing and improved SEO with the keyword bali777
  • Allow Googlebot to access everything
  • Allow Googlebot Image to access everything
  • Allow Googlebot-Mobile to access everything
  • Allow MSNBot to access everything
  • Allow Slurp (Yahoo) to access everything
  • Allow Teoma (Ask.com) to access everything
  • Allow Gigabot to access everything
  • Allow Robozilla to access everything
  • Allow Nutch to access everything
  • Allow ia_archiver to access everything
  • Allow Baiduspider (Baidu) to access everything
  • Allow Naverbot to access everything
  • Allow Yeti to access everything
  • Allow Yahoo-MMCrawler to access everything
  • Allow Psbot (Pinterest) to access everything
  • Allow Yahoo Blogs to access everything
  • Block all other crawlers except the ones listed above
  • Important SEO Keyword-Focused Pages
  • Sitemap location
Back to top