# We measured the BIST 100: 15 company sites are closed or… | QANATONE > None of Borsa Istanbul's 100 largest companies blocks the search crawlers of ChatGPT or Claude in robots.txt. Yet 15 of their sites are… Kaynak: https://www.qanatone.com/en/haber/bist-100-yapay-zeka-erisimi/ --- [News](https://www.qanatone.com/en/haber/) # We measured the BIST 100: 15 company sites are closed or empty for AI crawlers 13 Oct 2026 5 min read Data · AI search None of Borsa Istanbul's 100 largest companies blocks the search crawlers of ChatGPT or Claude in robots.txt. Yet 15 of their sites are effectively closed to AI because of firewalls, bot blocks or empty pages. ## What we measured On 13 October 2026 we measured the websites of all 100 companies in Borsa Istanbul's BIST 100 index, using the company list and web addresses filed with Türkiye's Public Disclosure Platform (KAP). For each site we checked robots.txt rules for AI crawlers, llms.txt, Organization schema on the home page, whether the page reads without JavaScript, and whether it opens for a request carrying an AI crawler's identity. Every site was measured twice: once with a non-browser client, as AI crawlers fetch pages, and once in real Chrome. ## Results - **0 companies** block the search and answer crawlers of ChatGPT, Claude or Perplexity in robots.txt. - **6** block crawlers that collect model training data, most of them only one bot. - **15** sites are open on paper but closed or empty for crawlers in practice. - **14** publish an llms.txt file; **28** have no robots.txt at all; **29** of 91 readable home pages carry Organization schema. **15 / 100** BIST 100 companies whose sites are effectively closed or empty for AI crawlers ## Open on paper, closed in practice Seven sites sit behind a firewall that rejects any non-browser client. Six return 403 to requests identified as GPTBot or ClaudeBot while serving the same page to a browser, most likely a one-click "block AI bots" setting at the hosting provider. Two home pages, Aselsan and ŞOK, are nearly empty without JavaScript, which most AI crawlers do not run. ## The missing ID card llms.txt and Organization schema are the two simple ways a site tells a machine who it is. Most BIST 100 companies use neither. We also found certificate problems on four sites, including one expired certificate. ## Limits The crawler-identity test imitates a bot; we cannot confirm from outside how the real GPTBot is treated. Three sites did not open in Chrome either and are excluded from the rates. Company-level results are in the [data file (CSV)](https://www.qanatone.com/veri/bist100-yapay-zeka-erisim-2026-10.csv). ## What it means for your business When someone asks an AI about your company, the answer is built from pages its crawler can read. A security setting that shuts the door, an empty home page or a missing ID card means the answer is built from what others write about you. Check three things: does your site open for a crawler, is the text there without JavaScript, and does the home page carry Organization schema. ## More articles [News · Science ### Coding agents raised code output, not finished work 12 Oct 2026 · 3 min](https://www.qanatone.com/en/haber/harvard-kodlama-ajanlari-calismasi/)[News · Models ### Meta opens its first frontier model, Muse Wonder, via API 12 Oct 2026 · 3 min](https://www.qanatone.com/en/haber/meta-muse-wonder-ilk-sinir-model/)[News · Models ### Microsoft on track to pay Anthropic $2B a year for Copilot 12 Oct 2026 · 3 min](https://www.qanatone.com/en/haber/microsoft-anthropic-copilot-odemesi/)[News · Infrastructure ### Microsoft's Maia 300 chip will run its AI services from 2027 12 Oct 2026 · 3 min](https://www.qanatone.com/en/haber/microsoft-maia-300-cikarim-cipi/)[News · Funding ### Amazon in talks to buy AI startup Decart for about $7 billion 11 Oct 2026 · 3 min](https://www.qanatone.com/en/haber/amazon-decart-7-milyar-dolar-gorusme/)[News · Funding ### Spend management startup Ramp valued at $60 billion 9 Oct 2026 · 3 min](https://www.qanatone.com/en/haber/ramp-60-milyar-dolar-degerleme/)[News · Policy ### White House unveils $6 billion science and AI package 8 Oct 2026 · 3 min](https://www.qanatone.com/en/haber/beyaz-saray-6-milyar-dolar-bilim-genesis/)[News · Search ### Google's September 2026 spam update has finished rolling out 8 Oct 2026 · 3 min](https://www.qanatone.com/en/haber/google-eylul-2026-spam-guncellemesi-tamamlandi/)