Log In Sign Up

directapp.net
robots.txt

Robots Exclusion Standard data for directapp.net

Resource Scan

Scan Details

Site Domain directapp.net
Base Domain directapp.net
Scan Status Ok
Last Scan2024-10-09T20:14:32+00:00
Next Scan 2024-10-16T20:14:32+00:00

Last Scan

Scanned2024-10-09T20:14:32+00:00
URL https://directapp.net/robots.txt
Domain IPs 104.21.75.64, 172.67.215.183, 2606:4700:3031::6815:4b40, 2606:4700:3037::ac43:d7b7
Response IP 104.21.75.64
Found Yes
Hash 62346ec38453fc358ead2c9e8630ffb7eeb9f2360250a1a8c6253bfd585d1b62
SimHash da2d51121aa3

Groups

*

Rule Path
Allow /category/game/feed
Allow /category/app/feed
Disallow /wp-admin/
Disallow /download/*
Allow /wp-admin/admin-ajax.php

sogou web spider

Rule Path
Disallow /

weborama-fetcher

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

addthis.com (http://support.addthis.com/)

Rule Path
Disallow /

weborama-fetcher

Rule Path
Disallow /

proximic

Rule Path
Disallow /

dotbot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://directapp.net/sitemap.xml
Back to top

Comments

  • The Ultimate robots.txt Bot and User-Agent Blocker
  • Copyright:
  • https://github.com/mitchellkrogza/apache-ultimate-bad-bot-blocker
  • Version Information
  • Version: V3.2019.02.1066
  • Updated: Tue Feb 19 09:54:59 SAST 2019
  • Bad Bot Count: 1770
  • Version Information
  • Start directapp
  • End directapp
Back to top