aplawrence.com
robots.txt

Robots Exclusion Standard data for aplawrence.com

Resource Scan

Scan Details

Site Domain aplawrence.com
Base Domain aplawrence.com
Scan Status Ok
Last Scan2025-11-23T17:40:33+00:00
Next Scan 2025-11-30T17:40:33+00:00

Last Scan

Scanned2025-11-23T17:40:33+00:00
URL https://aplawrence.com/robots.txt
Domain IPs 35.212.37.82
Response IP 35.212.37.82
Found Yes
Hash 91d1c99fb8cbf0bc33febed09bfee4148c4d8df2b0fd2dd15d85d56bb09b87d4
SimHash 1907c4cc58d7

Groups

mediapartners-google

Rule Path
Allow /
Disallow /subdtest

adsbot-google

Rule Path
Allow /
Disallow /subdtest

w3c

Rule Path
Allow /

*

Rule Path
Disallow /subdtest
Disallow /menus.html
Disallow /pub
Disallow /News.js
Disallow /Anatests
Disallow /Personal
Disallow /MissDow
Disallow /awstats.html
Disallow /var/ftp/pub/psst-sample.pdf
Disallow /cgi-bin/showpic.pl
Disallow /cgi-bin/deepindexget.pl
Disallow /cgi-bin/printer.pl
Disallow /cgi-bin/newcomm.pl
Disallow /cgi-bin/auth.pl
Disallow /cgi-bin/newest.pl
Disallow /cgi-bin/congetcity.pl
Disallow /cgi-bin/congetstate.pl
Disallow /cgi-bin/congetworld.pl
Disallow /cgi-bin/countad.pl
Disallow /cgi-bin/fatal.pl
Disallow /cgi-bin/forumpost.pl
Disallow /cgi-bin/freprint.pl
Disallow /cgi-bin/showrelated.pl?
Disallow /cgi-bin/getauthart.pl
Disallow /cgi-bin/mkltest.pl
Disallow /cgi-bin/mkpost.pl
Disallow /cgi-bin/nav.pl
Disallow /cgi-bin/randad.pl?
Disallow /cgi-bin/snav.pl
Disallow /cgi-bin/search3.pl
Disallow /cgi-bin/supersearch.pl
Disallow /cgi-bin/ta.pl
Disallow /cgi-bin/tester.pl
Disallow /Bela
Disallow /Maps
Disallow /errors
Disallow /itech
Disallow /Consultants/
Disallow /prepub
Disallow /buytests.html
Disallow /download.html
Disallow /contrib.html
Disallow /Unix/sample
Disallow /visitreport.html

Other Records

Field Value
sitemap http://aplawrence.com/sitemap.gz