Log In Sign Up

maxprog.com
robots.txt

Robots Exclusion Standard data for maxprog.com

Resource Scan

Scan Details

Site Domain maxprog.com
Base Domain maxprog.com
Scan Status Ok
Last Scan2024-06-03T09:12:12+00:00
Next Scan 2024-06-10T09:12:12+00:00

Last Scan

Scanned2024-06-03T09:12:12+00:00
URL https://maxprog.com/robots.txt
Redirect https://www.maxprog.com/robots.txt
Redirect Domain www.maxprog.com
Redirect Base maxprog.com
Domain IPs 104.26.10.14, 104.26.11.14, 172.67.68.131, 2606:4700:20::681a:a0e, 2606:4700:20::681a:b0e, 2606:4700:20::ac43:4483
Redirect IPs 104.26.10.14, 104.26.11.14, 172.67.68.131, 2606:4700:20::681a:a0e, 2606:4700:20::681a:b0e, 2606:4700:20::ac43:4483
Response IP 104.26.11.14
Found Yes
Hash 669576a3721a1e88e9f5c8f5958c9a5c9d79055ef52136d54ab16addcb27cc77
SimHash 6c74993341d1

Groups

*

Rule Path
Disallow /serials/
Disallow /prereleases/
Disallow /mlm/
Disallow /mlm
Disallow /misc/
Disallow /site/scripts/click/demo/
Disallow /site/scripts/click/demo/click.php
Disallow /store/invoice.php?t=*
Allow /store/index.php
Disallow /site/manuals/icash/_template/
Disallow /site/manuals/mbm/_template/
Disallow /site/offers/ad_click/adwords/
Disallow /site/software/internet-marketing/email-list-builder_sheet_*.php$
Disallow /site/scripts/list-manager/demo/html/
Disallow /site/scripts/unsubscribe/demo/
Disallow /forums/whats-new/
Disallow /forums/account/
Disallow /forums/attachments/
Disallow /forums/goto/
Disallow /forums/posts/
Disallow /forums/login/
Disallow /forums/admin.php
Back to top

Other Records

Field Value
sitemap http://a166683.sitemaphosting.com/4088741/sitemap.xml
Back to top

Comments

  • robots.txt file for maxprog
  • addresses all robots by using wild card *
  • list folders robots are not allowed to index
  • Disallow: /store_selector.php
  • Disallow: /m/
  • Disallow: /cgi-bin/
  • Allow: /store/rating_system_js_php/
  • Disallow: /site/javascript/
  • Disallow: /blog/archives/
  • Disallow: /blog/_archives/
  • Disallow: /blog/about/
  • Disallow: /mobile/
  • Disallow: /screencasts/*.html
  • XenForo
  • phpBB
  • Disallow: /forum/admin/
  • Disallow: /forum/db/
  • Disallow: /forum/includes/
  • Disallow: /forum/language/
  • Disallow: /forum/templates/
  • Disallow: /forum/custom.php
  • Disallow: /forum/config.php
  • Disallow: /forum/groupcp.php
  • Disallow: /forum/login.php
  • Disallow: /forum/modcp.php
  • Disallow: /forum/posting.php
  • Disallow: /forum/printview.php
  • Disallow: /forum/privmsg.php
  • Disallow: /forum/profile.php
  • Disallow: /forum/search.php
  • Disallow: /forum/viewonline.php
  • view=print parameters
  • Disallow: /forum/viewtopic.php?view=print&*
  • Disallow: /forum/viewtopic.php?*&view=print&*
  • Disallow: /forum/viewtopic.php?*&view=print$
  • urls containing sid
  • Disallow: /forum/*?sid=*
  • Disallow: /forum/*&sid=*
  • Disallow: /forum/post-*.html$
  • Disallow: /forum/about*.html$
  • Disallow: /forum/acp/
  • Disallow: /forum/common.php$
  • Disallow: /forum/config.php$
  • Disallow: /forum/cron.php$
  • Disallow: /forum/mcp.php$
  • Disallow: /forum/memberlist.php$
  • Disallow: /forum/posting.php$
  • Disallow: /forum/report.php$
  • Disallow: /forum/ucp.php$
  • Disallow: /forum/viewonline.php$
  • Disallow: /forum/updates-topic.html*$
  • Disallow: /forum/stop-updates-topic.html*$
  • Disallow: /forum/ptopic*.html$
  • Disallow: /forum/ntopic*.html$
  • list specific files robots are not allowed to index
  • Disallow: /myfolder/myfile.txt
  • End of robots.txt file
Back to top