Log In Sign Up

popyachts.com
robots.txt

Robots Exclusion Standard data for popyachts.com

Resource Scan

Scan Details

Site Domain popyachts.com
Base Domain popyachts.com
Scan Status Ok
Last Scan2024-09-12T01:25:34+00:00
Next Scan 2024-10-12T01:25:34+00:00

Last Scan

Scanned2024-09-12T01:25:34+00:00
URL https://popyachts.com/robots.txt
Domain IPs 52.7.148.161, 54.85.239.154
Response IP 52.7.148.161
Found Yes
Hash 695775c31062e2cd6da9ba33c9011050320ced4e602a60cb3ad9e87173b1cffd
SimHash a0747166c80b

Groups

adsbot-google

Rule Path
Allow /
Disallow

mediapartners-google

Rule Path
Allow /
Disallow

yandex

Rule Path
Disallow /

sogou

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

youdaobot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

baiduspider-video

Rule Path
Disallow /

baiduspider-image

Rule Path
Disallow /

naverbot
yeti

Rule Path
Disallow /

moget
ichiro

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

*

Rule Path
Disallow /Get-Advanced-Search-Menu-HTML.asp
Disallow /Get-Awards.asp
Disallow /Get-Cache.asp
Disallow /Get-Cookie.asp
Disallow /Get-Customer-Visit-Times.asp
Disallow /Get-Customer-Visit-Times2.asp
Disallow /Get-Deal-Document-Next.asp
Disallow /Get-Doc-Notification.asp
Disallow /Get-Feedback.asp
Disallow /Get-Listing-Canonical.asp
Disallow /Get-Listing-Categories.asp
Disallow /Get-Listing-Category-Children.asp
Disallow /Get-Listing-Cities.asp
Disallow /Get-Listing-Comps.asp
Disallow /Get-Listing-Comps-Sold.asp
Disallow /Get-Listing-Make-Cousins.asp
Disallow /Get-Listing-Makes.asp
Disallow /Get-Listing-Manufacturer.asp
Disallow /Get-Listing-Models.asp
Disallow /Get-Listings.asp
Disallow /Get-Listings2.asp
Disallow /Get-Listing-Search-Data.asp
Disallow /Get-Listings-Featured.asp
Disallow /Get-Listings-Nearby.asp
Disallow /Get-Listings-New.asp
Disallow /Get-Listings-Published.asp
Disallow /Get-Listings-Sold.asp
Disallow /Get-Listings-Recently-Viewed.asp
Disallow /Get-Navigation-Menu-Search-Categories.asp
Disallow /Get-Posts-Archived.asp
Disallow /Get-Recommendations.asp
Disallow /Get-Reviews.asp
Disallow /Get-Side-Search-Menu-HTML.asp
Disallow /Get-Surveyors.asp
Back to top

Other Records

Field Value
sitemap https://www.popyachts.com/sitemap.xml
sitemap https://www.popyachts.com/listings.xml
sitemap https://www.popyachts.com/listings-by-state.xml
sitemap https://www.popyachts.com/listings-by-city.xml
sitemap https://www.popyachts.com/listing-makes-by-price-range.xml
sitemap https://www.popyachts.com/categories.xml
sitemap https://www.popyachts.com/makes.xml
sitemap https://www.popyachts.com/category-landing-pages.xml
sitemap https://www.popyachts.com/categories-by-price-range.xml
sitemap https://www.popyachts.com/cities.xml
sitemap https://www.popyachts.com/surveyors.xml
sitemap https://www.popyachts.com/surveyors-by-postal-code.xml
sitemap https://www.popyachts.com/posts.xml
Back to top

Comments

  • The use of robots, crawlers, spiders, rovers, scrapers or other automated
  • means to access or mine data from popyachts.com without the express
  • written permission of Pop Sells, LLC is strictly prohibited.
  • Pop Sells may permit access to any or all of its web sites for the
  • limited purpose of including content in publicly available search engines,
  • but only if those search engines are not specific to the boating industry
Back to top

Warnings

  • 2 invalid lines.
Back to top