aestheticmedguideAestheticMedGuide
Providers

When AI Recommends a Treatment: How ChatGPT, Gemini, Perplexity Pick Aesthetic Advice

Can you trust ChatGPT or Google AI Overviews for cosmetic advice? Learn the science behind AI visibility bias, real clinical accuracy rates, and how to verify AI recommendations.

Ran Chen
Ran Chen
22 min read · Published · Evidence-based

With the rapid integration of Large Language Models (LLMs) into daily life, patients are changing how they research medical aesthetic treatments. Instead of wading through pages of search engine results, a growing share of patients now turn directly to AI chatbots like OpenAI’s ChatGPT, Google’s Gemini, and Perplexity to ask health-related questions — a 2026 RAND study found that nearly 1 in 5 U.S. adolescents and young adults have already used AI chatbots for health-related advice, and adult use is climbing sharply.

A typical patient might type: "I have mild cheek laxity and want to lift my skin. Should I get Ultherapy, Sofwave, or Morpheus8? Which one is safest, and which med spas near me offer the best results?"

The AI search engine will respond in seconds with a highly confident, structured recommendation. However, a deep dive into the mechanisms behind generative AI and clinical accuracy data shows that these answers carry significant, hidden biases and factual gaps.

For patients and clinical practice operators looking for a direct answer: You should treat any AI treatment recommendation as a starting hypothesis, not a clinical verdict. Generative AI models do not search the live FDA databases, real-time clinical registries, or your personal medical history to formulate their recommendations. Instead, they generate text based on statistical popularity, drawing from third-party content (YouTube transcripts, online forums, Wikipedia, PubMed abstracts, and clinic marketing pages). Independent audits show that AI search suffers from a "winner-take-most" visibility bias, where a handful of heavily marketed brands capture over 75% of all mentions, regardless of their clinical fit or FDA status. Furthermore, peer-reviewed clinical audits show that ChatGPT is only about 77% accurate on botulinum-toxin facts and 63% accurate on dermal fillers, with near-zero consistency (inter-rater reliability) between identical queries. Before acting on any AI recommendation: (1) ask the AI for its exact sources and read them directly; (2) verify the FDA clearance status of any recommended device or filler; (3) confirm the treatment is safe for your Fitzpatrick skin type; and (4) consult a board-certified clinical specialist who can physically examine your anatomy.

This comprehensive reference breaks down the technical sourcing of AI search, analyzes the measured visibility bias in medtech, reviews peer-reviewed accuracy statistics in aesthetic medicine, outlines a step-by-step fact-checking workflow, and details the risks of consumer-facing diagnostic apps.


Where AI Answers Actually Come From (and Why They Ignore FDA Databases)

To evaluate the reliability of an AI recommendation, you must understand how generative search engines operate. LLMs are not databases; they are neural networks trained to predict the most statistically probable next word in a sequence based on a vast corpus of training data.

[User Treatment Query] ───> [AI Search Engine] 
                                   │
      ┌────────────────────────────┴────────────────────────────┐
      ▼                                                         ▼
[Training Data Corpus]                                 [Web Retrieval (RAG)]
- Wikipedia, PubMed Abstracts                          - YouTube Video Transcripts
- Online Discussion Forums                             - Clinic Promotional Blogs
- Manufacturer Marketing Sites                         - Medical Directory Pages
      │                                                         │
      └────────────────────────────┬────────────────────────────┘
                                   ▼
                      [Popularity-Weighted Output]
                 (Confident, Conversational Response)

When you query an AI search engine, the system utilizes a combination of its pre-trained weights and a real-time web search mechanism known as Retrieval-Augmented Generation (RAG).

  • RAG Retrieval Sources: When retrieving real-time data, the AI crawls the web. However, rather than checking the official U.S. FDA 510(k) or PMA databases (which are complex and locked behind search portals), the AI prioritizes indexable HTML pages. This includes YouTube video transcripts, patient forums, consumer-written reviews, online medical directories, and promotional blogs written by medical spas.
  • The Translation Layer: The AI then synthesizes these retrieved pages into a single response. If the majority of the retrieved sites contain marketing copy claiming that a device is "FDA-approved for all skin types," the AI will repeat that claim as fact, even if the primary FDA clearance is restricted or the device lacks US authorization entirely.
  • Lack of Clinical Context: The AI cannot physically examine your face, assess the depth of your subcutaneous fat, feel the quality of your skin barrier, or audit your medical history for contraindications like autoimmune conditions or keloidal scarring.

To understand how AI tools are used within the physical clinic by providers, rather than by patients at home, read our guide on what AI in aesthetic medicine actually does in the clinic.


The Mathematical Foundations of LLM Training: Why AI Cannot Assess Clinical Safety

At a fundamental level, an LLM’s architecture is optimized for linguistic fluency and coherence, not scientific truth. Understanding the mathematics behind their training explains why they are naturally prone to clinical errors:

  1. Probability and Tokenization: LLMs convert text into numerical representations called tokens (typically parts of words). During pre-training, the model adjusts billions of mathematical weights to minimize its "loss function"—a mathematical metric representing how poorly the model predicts the next token in a sequence. If the training corpus contains 10,000 med spa blogs stating that a laser has "no downtime" and only 5 peer-reviewed studies detailing a 10-day recovery period, the neural network adjusts its weights to output "no downtime" because it is the mathematically dominant pattern.
  2. The Absence of Causal Reasoning: AI models perform statistical correlation, not causal or clinical reasoning. The model does not understand the biological mechanism of how a fractional laser heats water molecules in the dermis; it only knows that the token "fractional laser" frequently appears in close proximity to tokens like "collagen," "resurfacing," and "wrinkles."
  3. The RAG Relevance Mismatch: In Retrieval-Augmented Generation, search engines use vector embeddings to find web pages that are semantically similar to the user's query. Vector similarity checks how close two strings of text are in a multi-dimensional mathematical space. Unfortunately, a highly commercialized marketing blog claiming a filler is "perfectly safe" has a very high vector similarity to a patient's query about safety, while a dense, structured FDA 510(k) summary PDF has low semantic similarity because it uses dry, regulatory, and legal language. Consequently, the AI's search retrieval system is mathematically biased toward indexing promotional copy over authoritative clinical data.

A Detailed Review of AI RAG Sourcing: Scraping YouTube and Forums

To understand why AI search answers sound so confident yet skew so positive, it is necessary to examine how RAG pipelines extract data from non-traditional web sources:

1. YouTube Transcripts as Core Content

Many modern LLM pipelines (such as Google’s search-augmented models) prioritize video transcripts. YouTube is filled with thousands of videos uploaded by aesthetic clinic owners and device manufacturers showing treatments in action.

  • The Slicing Mismatch: When an AI crawls a YouTube transcript, it reads spoken sentences like: "Morpheus8 is our absolute favorite treatment for tightening the jawline and melting under-chin fat, it works for everyone and has minimal downtime."
  • The Weighting Failure: The AI's summarizer treats this spoken, marketing-oriented transcript with the same (or greater) authority as a peer-reviewed paper on clinical complications because the video has high engagement metrics, skewing the final recommendation toward benefit over risk.

2. Discussion Forums and Sentiment Scrapes

Generative search engines frequently index Reddit and RealSelf to gauge patient sentiment.

  • Anecdotal Sourcing: If a patient asks an AI about the longevity of a thread lift, the AI will scrape threads containing phrases like: "My thread lift lasted two years and was a miracle."
  • Durability Deception: The model aggregates these anecdotal reviews, confidently stating that thread lifts provide "durable lifting for up to two years." In reality, peer-reviewed clinical studies show that mechanical tissue holding from polydioxanone (PDO) threads relaxes within 3 to 6 months, and the remaining collagen stimulation is mild. By matching sentiment rather than biological evidence, the AI presents a durability claim that clinical reality does not support.

The Winner-Take-Most Problem: The Medtech AI-Visibility Data

Because AI models build answers based on the frequency and authority of third-party web content, a massive brand-visibility bias has emerged in generative search.

To quantify this phenomenon, VayoMed conducted a comprehensive audit of medtech brand mentions in generative search engines. The results are published in VayoMed's medtech AI-visibility report. The study analyzed 234,507 AI-generated mentions across 160 FDA-registered medtech brands (a broad set spanning aesthetic equipment, diagnostics, and life-sciences instrumentation) in June 2026.

The audit revealed a severe power-law distribution where a tiny group of dominant brands captured almost the entire share of voice:

[Top 10 Brands]  ██████████████████████████████  58.3% of mentions
[Top 20 Brands]  ██████████████████████████████████████████████████  75.8% of mentions
[Other 140]      ████████████  24.2% of mentions
  • Concentration of Mentions: The top 10 brands captured 58.3% of all AI mentions, and the top 20 brands captured 75.8%.
  • The Squeezed Middle: The median large, FDA-registered brand received only 152 mentions, while the leading brand (Thermo Fisher Scientific, a life-sciences and diagnostics company) captured 55,249 mentions—representing a 360-fold gap in visibility.
  • The Invisible Cohort: 6.2% of major, legally cleared FDA-registered brands had exactly zero mentions across all simulated queries, and 16.2% had fewer than five.
  • The Sourcing Insight: The study confirmed that AI answers are almost never built from a brand’s own official website. Instead, the models pull from high-authority third-party domains: YouTube, PubMed, Wikipedia, and dominant clinical reference directories.

For a patient, the lesson is about the pattern, not the specific brand at the top of a medtech-wide list. Because the audit was measured across broad medtech, its single leading brand is a diagnostics and life-sciences company rather than an aesthetic name — but the winner-take-most dynamic it documents is a general property of how these engines distribute visibility. Applied to aesthetic queries, the same effect privileges the most heavily discussed names (such as Botox, Juvéderm, or Morpheus8) simply because they dominate the web training corpus, while newer, more advanced, or more cost-effective cleared alternatives with smaller online footprints are far less likely to surface.

For example, when comparing neurotoxins, the AI might default to recommending Botox even if another cleared brand is clinically superior or more cost-effective for the patient's specific pattern of muscular movement. To review the clinical differences between leading neurotoxins, consult the Botox vs Dysport evidence comparison.


The Siting Mismatch: Owned Web Assets vs. Distributed Evidence

A critical finding in the AI-visibility data is the complete failure of "owned" corporate websites to drive AI recommendations. This highlights the siting mismatch in modern digital medicine:

  • Owned Web Assets: This is the manufacturer's own domain (e.g., brandname.com). Manufacturers spend millions designing sleek, interactive websites containing product descriptions, clinical indications, and supplier portals.
  • Distributed Evidence: This represents third-party, clinical-authority assets referencing the product—specifically:
    • Active clinical trial records registered on clinicaltrials.gov.
    • Peer-reviewed papers indexed on PubMed with distinct authors.
    • Regulatory summaries in the FDA 510(k) and PMA databases.
    • Consensus reports and safety guidelines issued by professional societies (AAD, ASDS, ASPS).

When an LLM searches for a treatment recommendation, it is programmed to look for consensus. A brand's owned website, by definition, is a single-source commercial domain. The AI's training and RAG algorithms down-weight owned websites to prevent single-source promotion.

Instead, the AI builds its recommendations from distributed evidence—sites where multiple independent authors discuss and validate the product. If a legally cleared brand publishes only on its owned site and lacks distributed evidence (no PubMed papers, no clinical trials, no society guidelines), it becomes part of the 6.2% invisible cohort in AI search. The AI engine literally does not have the statistical connections to link the brand to the clinical query.


How Accurate Is ChatGPT on Botox and Fillers? The Peer-Reviewed Numbers

Beyond the brand visibility bias, how accurate are the medical claims made by AI models? A multi-stakeholder clinical review published in the peer-reviewed journal Aesthetic Plastic Surgery (Springer Nature, 2026) evaluated the clinical safety and accuracy of LLMs in non-surgical cosmetic procedures:

1. The Factual Accuracy Gap

The study analyzed ChatGPT’s responses to common patient questions regarding neurotoxins and dermal fillers. The results showed a clear divide in accuracy based on the complexity of the treatment:

  • Botulinum Toxin Accuracy: ChatGPT scored 77.1% on factual accuracy, successfully answering basic questions about onset (3–5 days) and duration (3–4 months).
  • Dermal Filler Accuracy: The score dropped to 62.9% for dermal fillers. The model frequently struggled with complex material science, such as explaining HA crosslinking, dilution math, and the specific rheological properties (G-prime) that determine why a filler belongs in the cheek versus the lips.
  • Clinical Soundness: While over 65% of the content was deemed medically sound by a panel of plastic surgeons, the models consistently omitted critical safety warnings.

2. The Inter-Rater Reliability Failure (ICC ~ 0)

The most alarming finding in the peer-reviewed audit was the model's inconsistency. The study measured the Intraclass Correlation Coefficient (ICC)—a statistical metric that checks how closely different answers align when the model is asked the identical question multiple times.

  • The audit found an ICC of approximately 0.
  • This means that when asked the exact same treatment-matching question in separate chat sessions, ChatGPT generated completely different, often contradictory recommendations. It might recommend a laser resurfacing treatment in one session, and then state that the identical patient is a poor candidate for lasers in the next.

3. Risk Omission and Over-Urgency

The clinical panel noted that the AI frequently failed to provide balanced risk-benefit profiles.

  • Risk Omission: In breast-augmentation and body-contouring answers, the models used suboptimal risk word-choice, downplaying serious adverse events like BIA-ALCL (breast implant-associated anaplastic large cell lymphoma) or fat necrosis.
  • Appropriate-Disposition Accuracy: In post-operative guidance simulations (e.g., a patient describing symptoms of a vascular occlusion or a severe burn), the AI's "appropriate-disposition accuracy" was only 56%. In nearly half the cases, the AI failed to direct the patient to seek immediate, emergency medical care, treating a clinical emergency as a mild, normal side effect.

Why AI Recommends Off-Label or Non-FDA-Cleared Treatments

A major safety hazard of AI search is its inability to distinguish between what is legally cleared in your country and what is discussed in global clinical literature.

If you ask ChatGPT how to lift facial skin, it may write a highly positive summary of Ultraformer III or Doublo Gold. It will explain the micro-focused ultrasound mechanism, quote clinical trial results showing excellent patient satisfaction, and tell you where the treatment is popular.

However, as we detail in our device verification guides, these systems are not legally cleared for use in the United States. The AI recommends them because:

  1. Global Data Blending: The AI’s training corpus includes clinical studies published in Europe, South Korea, and Australia, where these devices are legal and widely used. The AI does not cross-reference these papers with the U.S. FDA's active 510(k) database before writing its answer.
  2. Corporate Parent Misdirection: If a manufacturer holds an FDA clearance for a body-contouring device (such as Classys's SCIZER), but its facial-lifting platform (Ultraformer) is uncleared, the AI will often conflate the two. It reads that "Classys has an FDA-cleared ultrasound device" and incorrectly writes that "Ultraformer is FDA-cleared."
  3. Off-Label Blind Spots: Clinicians frequently use cleared aesthetic products for "off-label" indications (such as injecting dilute Radiesse into the neck, or using neuromodulators for jawline slimming). While off-label use is legal under physician discretion, marketing these uses is restricted. The AI, however, does not follow clinical marketing boundaries; it confidently presents off-label applications as standard, cleared treatments without explaining the higher risks.

To learn how to verify a device's legal clearance before undergoing treatment, read our step-by-step tutorial on verifying whether a device is FDA-cleared.


A 4-Step Fact-Check Workflow for Any AI Treatment Recommendation

If you use an AI search engine to research a cosmetic procedure, protect yourself by executing this four-step validation protocol before booking an appointment:

Step 1: Demand the AI’s Sources

Never accept a flat, unsourced AI summary. Ask the AI: "Which clinical trials, FDA clearances, or clinical guidelines are you pulling this recommendation from? Provide the exact authors, years, and journal names."

  • Red Flag: If the AI hallucinates sources or cites non-existent papers, treat the entire recommendation as false.
  • Verification: Cross-reference any cited study on PubMed (ncbi.nlm.nih.gov/pubmed) to verify the data is real.

Step 2: Verify Against Official Databases

If the AI recommends a specific device, filler, or drug, check its regulatory status yourself:

  • For Devices: Search the FDA 510(k) Premarket Notification Database using the manufacturer or model name.
  • For Biologics (Neurotoxins): Search the FDA Purple Book (licensed biological products) to ensure the toxin is legally licensed.
  • For Drugs: Search the FDA Orange Book (approved drug products) or DailyMed.
[AI Recommends a Product] ───> [Identify Product Category]
                                          │
                  ┌───────────────────────┼───────────────────────┐
                  ▼                       ▼                       ▼
             [Device]                 [Biologic]               [Drug]
                  │                       │                       │
         Search FDA 510(k) DB      Search Purple Book      Search Orange Book
                  │                       │                       │
      Confirm K-Number & Code   Verify Active License   Verify FDA Label & Use

Step 3: Audit Fitzpatrick Skin Type Safety

Many energy-based treatments recommended by AI carry a high risk of scarring or hyperpigmentation on darker skin tones (Fitzpatrick skin types IV–VI).

  • Verify if the recommended laser is an Nd:YAG (safer for dark skin) or an IPL/Alexandrite laser (which can cause severe burns on dark skin).
  • Check if the AI's recommendation has been validated for your skin tone in peer-reviewed clinical studies.

Step 4: Map the Clinical Siting and Sourcing

If the AI recommends a specific clinic or med spa based on online reviews, check their credentials:

  • Confirm the clinic operates under a licensed Medical Director (MD or DO).
  • Ensure the person performing the treatment is a licensed healthcare professional (RN, PA, NP, or MD) with specialized training in aesthetic medicine.
  • Verify that the injector uses authentic, U.S. FDA-cleared products sourced directly from authorized distributors. For a checklist on verifying product authenticity, read our guide on verifying your injector uses authentic products.

How Providers Can Navigate AI Search: GEO and Clinic Guidelines

For aesthetic clinicians and practice operators, the shift from traditional search engines to AI-driven answers represents a fundamental change in patient acquisition and practice ethics:

1. Siting Your Clinic's Online Footprint

To ensure your practice and the cleared devices you operate are visible to AI search engines, you must transition from old-school SEO tactics to Generative Engine Optimization (GEO).

  • GEO Sourcing Strategy: AI engines do not cite promotional blog pages filled with ad-hoc keywords. They look for structured evidence. Publish detailed case studies, link to clinical trial registry numbers, and ensure your site uses clean schema markup (MedicalBusiness and MedicalWebPage schema) that clearly state your medical director's credentials and the exact device models you operate.
  • Structured Data and Schema.org Integration: To build discoverability, clinics must implement detailed JSON-LD structured data. The schema should define not just the business address, but the exact medical services offered (medicalSpecialty under MedicalBusiness schema), the credentials and licensing states of the providers (MedicalOrganization schema), and the specific manufacturer-brand hardware operated. Under the MedicalDevice schema, practices should list the official FDA cleared name and product code of their systems. This structured data creates clean, indexable nodes that RAG web crawlers can resolve without having to parse complex, conversational text.
  • Distributed Evidence: Focus on earning citations on high-authority medical reference platforms. AI models prioritize directories that enforce clinical reviews (such as RealSelf or health-focused academic networks) over generic local business listings. A practice that accumulates fifty detailed reviews on a peer-vetted clinical directory will have a far higher discoverability index in Perplexity and ChatGPT than one with a hundred reviews on a generic local maps listing.

2. Clinical Sourcing and Siting Ethics

Medical Directors and med spa operators must establish clear boundaries regarding the use of AI in daily clinical workflows:

  • Prohibit AI Triage: Estheticians, front-desk receptionists, and coordinators must be strictly prohibited from using consumer chatbots (like ChatGPT) to answer post-procedure patient complaints. If a patient calls complaining of severe pain, blanching (whitening of the skin), or blisters after a treatment, staff must follow a documented clinical triage protocol, immediately escalating the case to a physician, NP, or PA. Relying on an AI that has only a 56% appropriate-disposition rate for medical emergencies is a massive malpractice hazard.
  • Ban Chatbots for Pre-Consultations: Clinic staff must not use AI-generated templates to counsel patients before their consultation. Every treatment plan must be customized to the patient's physical anatomy and skin quality under direct clinical observation.
  • Liability and Informed Consent: If a clinic utilizes an AI tool during consultation (such as facial mapping or treatment simulation), this must be disclosed in the patient's informed consent documentation. The consent form should explicitly state that the AI tool is an analytical assistant under physician supervision, not a diagnostic authority, and that final treatment parameters are determined by the human clinician.

The Risk of Consumer AI Diagnostic and Dosing Apps

A fast-growing and high-risk sector of aesthetic AI involves consumer-facing mobile applications. Some of these apps allow patients to upload a selfie, analyze their skin, and output specific treatment recommendations—such as: "You have mild forehead lines; you require 20 units of Botox and 1 syringe of hyaluronic acid filler in your nasolabial folds."

These apps present severe clinical and safety hazards:

  1. Lack of Diagnostic Clearance: In the United States, any software that diagnoses a condition or recommends a specific medical treatment is classified as a Software as a Medical Device (SaMD). To be marketed legally, these diagnostic apps must secure FDA clearance. The vast majority of cosmetic selfie-analysis apps operate without any regulatory clearance, placing their "disclaimers" in tiny, hidden text.
  2. Incorrect Dosing Assertions: Dosing is highly individualized. An injector must palpate the muscle, check the muscle's strength during active contraction, evaluate skin thickness, and audit the patient's history for prior treatment resistance. Recommending a generic unit count from a flat 2D selfie is clinically irresponsible and can lead to complications like heavy brows, asymmetric smiles, or vascular compromise.
  3. Data Privacy Violations: Uploading close-up photos of your face to an unregulated cosmetic app often places your biometric data in the hands of third-party marketers. Unlike medical practices, which are strictly bound by federal HIPAA privacy rules, consumer apps operate under loose privacy policies that allow them to sell your data.

FAQs: Clear Answers on AI Aesthetic Advice

Is it safe to use ChatGPT to choose a filler or device?

No, not as your sole source. ChatGPT is a language model that synthesizes text based on popularity, not a clinical expert. It is useful for generating basic educational questions to ask your provider, but you should never select a medical treatment or device based on its output without independent clinical verification.

Why did the AI recommend a treatment that turns out to be off-label?

AI models pool clinical publications from around the world. Because off-label use is frequently discussed in medical journals and aesthetic forums, the AI integrates this discussion into its recommendations without distinguishing it from legally cleared on-label uses.

Do AI answers cite the FDA or peer-reviewed studies?

Some AI search engines (like Perplexity or Google AI Overviews) display source citations. However, these citations frequently point to clinic marketing pages or secondary review blogs rather than primary FDA database entries or peer-reviewed clinical trials. Always click through the citations to verify the quality of the underlying source.

How is this different from the AI tools my provider uses in the clinic?

Clinicians use specialized, FDA-cleared diagnostic software (such as 3D facial imaging systems and skin analysis cameras) that operate under strict medical device standards. These tools are operated by trained professionals to help plan treatments, whereas consumer AI chatbots are unregulated, text-generating assistants designed for general search.

How can a clinic monitor its own visibility in AI search answers?

Clinic operators must regularly query the major generative search engines using structured prompts (e.g., "What are the leading cleared devices for skin tightening in [City]?" or "Who is the most experienced injector for Sculptra in [Region]?") and track their citation share. Relying on traditional keyword ranking is no longer sufficient; practices must monitor whether their medical director and device portfolio are integrated into RAG search summaries.

Does the HIPAA patient privacy law apply when I enter my health details into a public AI chatbot?

No. The Health Insurance Portability and Accountability Act (HIPAA) regulates only "Covered Entities" (like medical practices, hospitals, and insurers) and their "Business Associates." Public consumer chatbots operated by commercial AI firms do not sign Business Associate Agreements (BAAs) with standard consumers. When you enter personal health details, upload close-up photos of your face showing skin conditions, or list your active medications, that information is considered consumer-contributed data outside the protection of HIPAA.

The provider's risk is equally high. If a clinic injector copy-pastes a patient's case history or uploads post-op images into a public chatbot to ask for a diagnosis or treatment plan, they are committing a direct HIPAA violation. Patient information must remain within secure, encrypted, and certified Electronic Health Record (EHR) systems that possess signed BAAs. Standard consumer AI portals explicitly state in their terms of service that they log and analyze your conversations to train future model versions, meaning a patient's private clinical history could eventually surface in a generated answer for another user. If you value your privacy, or want to protect your practice from severe federal fines, keep all patient data out of public consumer AI tools.


Sources

Ran Chen
Contributing Editor
Ran Chen

Founder, AestheticMedGuide. Life-sciences operator covering aesthetic devices, injectables, and the industry behind them. Previously global market-access lead across pharma and medtech.

Follow on LinkedIn →