appsflyer.com
robots.txt

Robots Exclusion Standard data for appsflyer.com

Resource Scan

Scan Details

Site Domain appsflyer.com
Base Domain appsflyer.com
Scan Status Ok
Last Scan2024-05-11T05:51:40+00:00
Next Scan 2024-05-18T05:51:40+00:00

Last Scan

Scanned2024-05-11T05:51:40+00:00
URL https://appsflyer.com/robots.txt
Redirect https://www.appsflyer.com:443/robots.txt
Redirect Domain www.appsflyer.com
Redirect Base appsflyer.com
Domain IPs 44.208.221.53, 52.6.56.82
Redirect IPs 184.27.122.202, 184.28.235.178, 184.28.235.208, 2600:1413:b000:1e::17d1:2e44, 2600:1413:b000:1e::17d1:2e56
Response IP 23.59.80.185
Found Yes
Hash f11d0a34a415979af3852cbc6bb15ac290a74a0ed78cac602e7f82e9a30340fd
SimHash 2a33757adc29

Groups

*

Rule Path
Allow /wp-content/*.css$
Allow /wp-includes/*.css$
Allow /wp-content/*.js$
Allow /wp-includes/*.js$
Allow /wp-content/*.css$
Allow /wp-includes/*.css$
Allow /wp-content/*.css?
Allow /wp-includes/*.css?
Allow /wp-content/*.js?
Allow /wp-includes/*.js?
Allow /wp-content/*.gif$
Allow /wp-content/*.jpg$
Allow /wp-content/*.jpeg$
Allow /wp-content/*.png$
Allow /wp-content/*.svg$
Allow /wp-content/*.pdf$
Allow /benchmarks/
Allow /benchmarks/ru/
Allow /benchmarks/es/
Allow /benchmarks/pt/
Allow /benchmarks/ko/
Allow /benchmarks/ja/
Allow /benchmarks/cn/
Allow /benchmarks/fr/
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /gatedpdfs/
Disallow /wp-content/
Disallow /expired-link/
Disallow /signup-error/
Disallow */cta/
Disallow */blog/login-content-countries/
Disallow */blog/outlets/
Disallow */blog/industries/
Disallow */blog/regions/
Disallow */blog/customer-industries/
Disallow */blog/related-products/
Disallow */blog/seasons/
Disallow */authors/
Disallow */login-content/
Disallow */blog/login-content/
Disallow */protected-pages/
Disallow */countries/
Disallow */blog/page/
Disallow */Infogramuploader/
Disallow /wp-content/uploads/
Disallow /blog/topic/*/feed/
Disallow /*?s=*
Disallow /page/
Disallow */?=glossary*
Disallow */?ref=*
Disallow /sp/
Disallow /jp/
Disallow /br/
Disallow /kr/
Disallow /cn/mobile-attribution-glossary/
Disallow /cn/mobile-fraud-glossary/
Disallow /jp/mobile-attribution-glossary/
Disallow /jp/mobile-fraud-glossary/
Disallow /br/mobile-attribution-glossary/
Disallow /br/mobile-fraud-glossary/
Disallow /sp/mobile-attribution-glossary/
Disallow /sp/mobile-fraud-glossary/
Disallow /kr/mobile-attribution-glossary/
Disallow /kr/mobile-fraud-glossary/
Disallow /fr/mobile-attribution-glossary/
Disallow /fr/mobile-fraud-glossary/
Disallow /*/search/
Disallow /*/charts/
Disallow /*/team/
Disallow /*/job/
Disallow /*/jobs-old/
Disallow /*/author/
Disallow /*/locations/
Disallow /*/infogramuploader/
Disallow /*/request-a-demo-conf/
Disallow /*/request-a-demo-index/
Disallow /*/request-demo-3/
Disallow /get-started-confirmation/
Disallow /get-started/partners-confirmation
Disallow /get-started/agencies-confirmation
Disallow /*/blog/author/
Disallow /*/blog/press/
Disallow /special-tools/
Disallow /request-a-demo/thank-you/
Disallow /benchmarks/de/*/
Disallow /benchmarks/ru/*/
Disallow /benchmarks/es/*/
Disallow /benchmarks/pt/*/
Disallow /benchmarks/ko/*/
Disallow /benchmarks/ja/*/
Disallow /benchmarks/cn/*/
Disallow /benchmarks/fr/*/

Other Records

Field Value
sitemap https://www.appsflyer.com/sitemap-en.xml
sitemap https://www.appsflyer.com/sitemap-ru.xml
sitemap https://www.appsflyer.com/sitemap-de.xml
sitemap https://www.appsflyer.com/sitemap-es.xml
sitemap https://www.appsflyer.com/sitemap-pt.xml
sitemap https://www.appsflyer.com/sitemap-ja.xml
sitemap https://www.appsflyer.com/sitemap-ko.xml
sitemap https://www.appsflyer.com/sitemap-fr.xml
sitemap https://www.appsflyer.com/image-sitemap.xml
sitemap https://www.appsflyer.com/cn/sitemap_index.xml

Comments

  • Allow CSS, JS, Images
  • Disallow existing pages based on localized websites
  • Sitemaps: EN + languages + images