Why You Can't Sleep: The Complete Guide to Sleep Disruption

After fifteen years working in sleep medicine — first as a junior doctor rotating through respiratory and neurology, then as a specialist in insomnia and circadian rhythm disorders — I've heard the same sentence hundreds of times: "I just can't sleep." It's the most common complaint I encounter, and it's also the most misunderstood.

Most people assume they have "insomnia" and that the fix is either sleeping pills or willpower. In reality, chronic sleep difficulty is almost never one thing. It's a web of interacting factors — your caffeine habits, your screen exposure, your stress levels, your sleep timing, your exercise patterns, your alcohol use, and often a feedback loop where poor sleep makes all of those worse.

The reason a single piece of advice ("just put your phone down" or "try chamomile tea") rarely solves the problem is that it's only addressing one thread in a tangled knot.

This guide is my attempt to lay out every major cause of sleep disruption, explain the mechanism behind each one, and give you a clear, evidence-based action plan for every single factor. It's long because the problem is complex. If you want a shortcut, jump to the step-by-step action plan at the end. But I'd encourage you to read the sections relevant to you — understanding why you can't sleep is the first step to actually fixing it.

1. Caffeine: The Hidden Half-Life Problem

Caffeine is the single most common sleep disruptor I see, and the one people are most reluctant to change. That's understandable — it's a legal, socially embedded drug that improves alertness, focus, and mood. The problem isn't that you drink coffee. The problem is that most people don't understand how long caffeine actually stays in their system.

Caffeine works by blocking adenosine receptors in your brain. Adenosine is the chemical that builds up the longer you're awake — it's what creates sleep pressure. When you drink caffeine, it sits in those receptors without activating them, effectively masking the signal that tells your brain it's time to sleep. The sleep pressure is still building, but you can't feel it.

The critical number is caffeine's half-life: 5 to 6 hours in a typical healthy adult. That means if you drink a 200mg coffee at 3pm, roughly 100mg is still circulating at 8–9pm. Fifty milligrams remain at midnight. Twenty-five milligrams are still active at 5am. Even those residual amounts can reduce deep sleep — the restorative stage your body needs most — by a measurable amount.

But here's what makes it even more complicated: your genetics determine how fast you metabolise caffeine. The CYP1A2 gene controls the enzyme that breaks down caffeine. About half the population are fast metabolisers with an effective half-life of 2–3 hours. The other half clear it more slowly, and roughly 10% are ultra-slow metabolisers whose half-life can stretch to 8–10 hours.

This is why your friend can drink espresso after dinner and sleep like a baby while you're staring at the ceiling at 1am after a single afternoon latte.

There's also the tolerance problem. Within a week of daily caffeine use, your brain upregulates adenosine receptors — it grows more receptors to compensate for the constant blocking. This means your daily coffee is doing progressively less to help you feel alert while doing progressively more to degrade your sleep quality. You need more caffeine to feel the same effect, and each cup chips away more at your sleep architecture.

What to do about it: Set a hard caffeine cutoff 8–10 hours before your intended bedtime. If you go to bed at 10pm, no caffeine after noon or 2pm at the latest. Track your total daily intake in milligrams, not just cups — it adds up faster than you think. And if you're genuinely sensitive to caffeine, consider a two-week reset to restore your receptor sensitivity. The first three days are rough, but the improvement in sleep quality is often dramatic.

For a complete breakdown of caffeine's effects on sleep — including the CYP1A2 gene and decaf myths — see our detailed guide on coffee and sleep.

2. Alcohol: The Sedation Myth

This one catches almost everyone off guard. Alcohol is the world's most widely used sleep aid — surveys consistently show that a significant percentage of adults in the UK use alcohol specifically to help them fall asleep. The problem is that alcohol doesn't improve sleep. It sedates you. There's a profound difference.

Sedation is unconsciousness without the normal architecture of sleep. When you drink alcohol before bed, you fall asleep faster — that part is true. But once the alcohol is metabolised (typically in the second half of the night), your brain rebounds into a hyper-aroused state. You experience fragmented sleep, reduced REM sleep, increased body temperature, and elevated heart rate. You may not remember waking up, but your body absolutely does.

The research on this is unambiguous. Even moderate alcohol consumption — two to three units — reduces REM sleep by 20–30%. REM sleep is where emotional processing, memory consolidation, and creative problem-solving occur. Chronic REM suppression is linked to impaired mood regulation, reduced cognitive performance, and increased anxiety. This is particularly insidious because the person drinking thinks alcohol is helping them sleep, while it's actually stealing the most restorative stages.

Alcohol also relaxes the muscles in your throat, which can worsen or create snoring and obstructive sleep apnoea. If you snore more on nights you drink, or if your partner notices your breathing becomes irregular after alcohol, this is why. Even if you don't have diagnosed sleep apnoea, alcohol-induced airway relaxation fragments sleep in ways you may not be consciously aware of.

And then there's the dehydration. Alcohol is a diuretic. It increases urine production, which can wake you up in the middle of the night needing the toilet. Add to that the rebound anxiety that many people experience as alcohol wears off — that 3am feeling of dread or restlessness — and you have a perfect recipe for a terrible night's sleep disguised as a helpful nightcap.

What to do about it: Stop drinking alcohol at least 3–4 hours before bed. If you're having more than a couple of units, make that 4–5 hours. If you're struggling with sleep, try a two-week alcohol-free period. The improvement in sleep quality is usually noticeable within three to four days, and by the end of the two weeks, most people report their best sleep in years. For a full analysis of how alcohol disrupts each sleep stage, read our guide on alcohol and sleep.

3. Blue Light and Screen Exposure

Your brain uses light — specifically the blue wavelengths (around 460–480nm) — as its primary signal for setting the circadian clock. When blue light hits specialized cells in your retina called intrinsically photosensitive retinal ganglion cells (ipRGCs), they send a signal to the suprachiasmatic nucleus (SCN) in your hypothalamus — your master body clock — that says "it's daytime, stay awake." This is useful during the day. At 10pm, when you're scrolling through your phone in bed, it's catastrophic.

Research published in the Proceedings of the National Academy of Sciences found that reading on an iPad before bed (versus a printed book) delayed melatonin onset by approximately 90 minutes, reduced evening sleepiness, delayed the circadian clock, and reduced next-morning alertness. These effects persisted even when participants slept the same total hours — the timing and architecture of sleep were degraded.

But here's the nuance that most articles miss: it's not just the blue light. It's the stimulation. Your phone isn't just emitting blue wavelengths. It's delivering social media notifications, news alerts, work emails, and algorithmic content designed to keep you engaged. The cognitive arousal from engaging with your phone is at least as disruptive as the light exposure itself.

A person scrolling through calming nature photos on their phone at 10pm is getting both light and cognitive stimulation. A person watching television across the room is getting light but less cognitive engagement. The effects compound.

There's also a timing dimension. Morning light exposure actually helps your sleep by reinforcing your circadian rhythm. The problem is specifically evening and nighttime light exposure when your body should be winding down. This is why people who work night shifts struggle with sleep — they're exposed to bright light when their body expects darkness, and vice versa.

What to do about it: Begin a screen curfew 60–90 minutes before bed. If you must use screens, use Night Shift / blue light filter modes and dim the brightness as low as possible — but understand this is a harm-reduction measure, not a solution.

Replace screen time with wind-down activities: reading a physical book, gentle stretching, conversation, or a warm bath. In the morning, get 10–15 minutes of bright light exposure (ideally sunlight) within the first hour of waking. This strengthens your circadian rhythm and makes you less vulnerable to evening light exposure.

Our complete guide on blue light and sleep covers the science and practical strategies in more detail.

4. Stress, Anxiety, and the Racing Mind

If your body lies down but your mind doesn't shut off, you're in excellent company. Stress and anxiety are the most common psychological causes of insomnia, and they create a vicious cycle that can be remarkably difficult to break.

When you're stressed, your body activates the hypothalamic-pituitary-adrenal (HPA) axis — the same system that produces the "fight or flight" response. Cortisol, your primary stress hormone, follows a natural rhythm: it peaks in the early morning (helping you wake up) and reaches its lowest point around midnight. Chronic stress flattens this curve, keeping cortisol elevated in the evening when it should be dropping. Elevated evening cortisol directly inhibits sleep onset by keeping your nervous system in a state of alertness.

Anxiety adds another layer. Generalised anxiety produces a pattern of cognitive hyperarousal — your mind generates worry, your body responds with tension, the tension makes you more aware of not sleeping, the awareness generates more worry, and the cycle escalates. This is why anxious people often say "I'm not even thinking about anything specific — my mind is just racing." The content of the thoughts matters less than the state of arousal they create.

Then there's the performance anxiety that develops around sleep itself. After several bad nights, you begin to dread bedtime. You lie down thinking "please let me sleep tonight" — which, paradoxically, is one of the most effective ways to prevent sleep. The effort of trying to sleep is counterproductive. Sleep is a passive process that requires the absence of effort. You can't force yourself to relax any more than you can force yourself to forget a song that's stuck in your head.

Cognitive Behavioural Therapy for Insomnia (CBT-I) is the gold standard treatment for this pattern, and it's more effective than sleeping pills in the long term. CBT-I works by dismantling the anxiety-sleep cycle through techniques like sleep restriction (paradoxically reducing time in bed to rebuild sleep drive), stimulus control (breaking the association between your bed and wakefulness), and cognitive restructuring (challenging catastrophic thoughts about sleep).

If stress-related insomnia has been a problem for more than a few weeks, CBT-I — either with a therapist or through a structured programme — is the single most effective intervention available.

Practical strategies for tonight: Try the "worry dump" — spend 10 minutes before bed writing down everything that's on your mind. The act of externalising worries onto paper reduces cognitive arousal at bedtime. Practice 4-7-8 breathing (inhale for 4 counts, hold for 7, exhale for 8) to activate your parasympathetic nervous system.

Keep a notepad by your bed for "brain dump" entries if thoughts arrive after lights-out — write them down and tell yourself you'll deal with them tomorrow. These are not cure-alls, but they can interrupt the cycle enough to allow sleep.

5. Poor Sleep Timing and Circadian Misalignment

One of the most overlooked causes of sleep difficulty is simply going to bed at the wrong time for your body. Your circadian rhythm — the roughly 24-hour cycle that governs when you feel alert and when you feel sleepy — is not uniform across the population. It varies by age, by genetics, and by lifestyle.

If you're a natural night owl (delayed chronotype) trying to fall asleep at 10pm because you "should," you're fighting your biology. Your body isn't ready to sleep yet. You'll lie in bed for an hour or more, building frustration and anxiety, before finally drifting off — and then you'll struggle to wake at 6:30am for work.

This pattern — lying in bed unable to sleep, followed by forced early waking — is one of the most common presentations of what gets labelled as "insomnia" but is actually a chronotype mismatch.

Equally problematic is irregular sleep timing. If you go to bed at 11pm on weekdays but midnight or 1am on weekends, you're creating a form of social jet lag. Your circadian clock can't adjust quickly enough to these shifts, so you're perpetually operating on a schedule that's out of sync with your biology. Research from Harvard Medical School found that social jet lag of even one hour was associated with poorer sleep quality, increased sleepiness, and higher levels of cortisol.

The timing of your last meal also matters. Eating a large meal within two to three hours of bedtime raises your core body temperature (digestion generates heat), and your body needs to cool down to initiate sleep. Late-night eating doesn't just add caloric load — it actively interferes with the thermoregulatory process that supports sleep onset.

What to do about it: Choose a consistent bedtime and wake time — including weekends — and stick to it within a 30-minute window. If you know you're a night owl, don't force an 10pm bedtime. Work with your chronotype: if your natural sleep onset is midnight and you need to wake at 7am, that's seven hours, which may be sufficient for many adults.

The key is consistency. Aim to finish your last meal at least two to three hours before bed. And if you're uncertain about your chronotype, try spending a week camping without artificial light — your natural timing will emerge quickly. For a deeper understanding of your body clock, see our guide on how circadian rhythms work.

6. Exercise: Right Activity, Wrong Time

Regular exercise is one of the most powerful sleep aids that exists. A meta-analysis of 66 studies published in the Journal of Behavioral Medicine confirmed that consistent exercise improves sleep quality, reduces sleep onset latency, and increases total sleep time. The mechanism is straightforward: exercise raises your body temperature, and the subsequent drop in temperature in the hours after exercise mirrors the natural thermoregulatory pattern that promotes sleep onset.

The problem is timing. Intense exercise — running, HIIT, heavy resistance training — within two to three hours of bedtime can be counterproductive. The elevated heart rate, core temperature, and adrenaline levels from vigorous exercise take time to subside. If you finish a 5k run at 9pm and get into bed at 10pm, your body is still in a state of physiological arousal.

However, the picture is more nuanced than "don't exercise at night." A 2019 study in Experimental Physiology found that evening exercise (at least one hour before bed) did not impair sleep in most participants, and in some cases improved it. The key variable was the type and intensity of exercise: moderate aerobic exercise (a brisk walk, light cycling, yoga) in the evening was either neutral or beneficial, while high-intensity exercise close to bedtime was disruptive.

Morning exercise has a specific advantage: it reinforces your circadian rhythm by combining physical activity with light exposure. This can be particularly helpful for people who struggle with sleep timing — a consistent morning exercise routine acts as a zeitgeber (time-giver) that strengthens your body clock.

What to do about it: Aim to exercise regularly — the benefits are well-established. If you prefer evening workouts, keep the intensity moderate and finish at least one to two hours before bed. If you do high-intensity training, try to schedule it for morning or early afternoon. Even a 20-minute brisk walk in the morning, combined with sunlight exposure, can meaningfully improve sleep quality within a few weeks. For more on exercise and sleep timing, see our full guide on exercise and sleep.

7. Sleep Debt: The Accumulated Deficit

Sleep debt is the concept that lost sleep accumulates over time and must be repaid. The science is clear that chronic sleep restriction — consistently getting less sleep than your body needs — creates a deficit that impairs cognitive performance, immune function, hormonal regulation, and mood. The question is whether that debt can be repaid.

The answer is nuanced. Short-term sleep debt (a few nights of poor sleep) can be partially recovered with one or two longer sleeps. If you've had three nights of five-hour sleep when you need eight, sleeping nine or ten hours for the next two nights will bring you closer to baseline. But chronic sleep debt — weeks or months of consistent under-sleeping — creates metabolic and neurological changes that a single long lie-in cannot reverse.

The most insidious aspect of sleep debt is that you stop noticing it. After a few days of restricted sleep, your subjective sense of sleepiness levels off. You feel "normal" — but your cognitive performance continues to decline. A landmark study by Dr. David Dinges at the University of Pennsylvania found that people restricted to six hours of sleep per night for two weeks showed cognitive impairment equivalent to someone who had been awake for 48 hours straight — but they didn't perceive themselves as significantly impaired.

They'd adapted to feeling terrible. This is the danger of sleep debt: it erodes your judgment about itself.

The UK's Royal Society for Public Health recommends that adults aim for 7–9 hours per night. If you're consistently getting fewer than seven hours, you are accumulating sleep debt regardless of whether you feel tired. The cumulative health consequences include increased risk of cardiovascular disease, type 2 diabetes, obesity, depression, and impaired immune function.

What to do about it: First, determine how much sleep you actually need — most adults need 7–9 hours, but the exact number is individual. Track your sleep for two weeks (using a wearable or a simple sleep diary) and note how many hours you need to wake naturally without an alarm.

That's your target. Then work backward: if you need to be awake at 7am and you need 8 hours, your bedtime is 11pm. Protect that window. If you've been chronically under-sleeping, accept that recovery takes time — you may need 8–9 hours for several weeks to fully clear the debt.

For a detailed guide on recovery strategies, see our article on sleep debt recovery.

8. Waking at 3am and Can't Get Back to Sleep

This is one of the most specific and distressing sleep complaints I hear. Patients fall asleep fine at 11pm, then jolt awake at 3am or 3:30am, fully alert and often flooded with anxiety. They watch the clock, calculate how many hours of sleep they've lost, and lie there in mounting panic as the minutes tick by. By the time their alarm goes off at 7am, they feel worse than if they hadn't slept at all.

The 3am waking has several physiological explanations. First, your body's core temperature reaches its nadir around 3–4am, and this temperature drop can trigger a brief arousal. Second, cortisol begins rising in the early morning hours as part of your natural circadian rhythm — this rise can be pronounced enough to pull you out of sleep, particularly if your cortisol curve has been disrupted by stress. Third, if you've been drinking alcohol, it's typically been fully metabolised by this point, triggering the rebound wakefulness described earlier.

There's also the psychological component. If you've experienced 3am waking a few times, you develop anticipatory anxiety about it. You go to bed thinking "I hope I don't wake at 3am" — and that thought itself creates the arousal that makes it more likely to happen. The clock-watching behaviour compounds the problem: every glance at the clock triggers a calculation ("if I fall asleep now, I'll get four hours") which generates more anxiety which generates more wakefulness.

What to do about it: If you wake at 3am, do not look at the clock. Turn it away from you or cover the display. If you're still awake after approximately 20 minutes, get up. Go to another room, do something quiet and non-stimulating (reading under dim light, gentle stretching), and return to bed only when you feel genuinely sleepy.

This prevents your brain from associating your bed with the frustration of wakefulness. Most importantly, address the underlying cause: if it's alcohol, stop drinking earlier. If it's stress, work on pre-sleep wind-down. If it's habitual, CBT-I is particularly effective at eliminating chronic night waking. Our detailed article on why you wake at 3am explores every mechanism and solution.

9. Your Sleep Environment

You can do everything right in terms of behaviour and still struggle if your bedroom is working against you. The sleep environment has four key variables: temperature, light, noise, and comfort.

Temperature is the most underrated factor. Your body needs to drop its core temperature by about 1°C to initiate and maintain sleep. A bedroom above 18°C (64°F) actively works against this process. The optimal temperature for most people is between 16–18°C (60–64°F). This is cooler than most people keep their bedrooms, and it's a common reason for poor sleep that has nothing to do with caffeine, stress, or screens.

Light should be near-zero in your bedroom. Even small amounts of ambient light — a standby LED, light leaking under the door, the glow of a charger — can suppress melatonin production and disrupt sleep architecture. Blackout curtains or a good sleep mask can make a significant difference.

Noise is highly individual. Some people sleep through anything; others are woken by a radiator click. If you live in an urban area, a white noise machine or earplugs can help by masking unpredictable noises. The issue isn't constant background noise — it's sudden changes in sound level that trigger arousal.

Comfort includes your mattress, pillows, and bedding. An old or unsupportive mattress is a common cause of back pain and fragmented sleep. If your mattress is more than seven to eight years old, or if you wake with aches and pains, it may be time to consider a replacement. The right pillow depends on your sleep position — side sleepers generally need a firmer, higher pillow than back sleepers.

What to do about it: Cool your bedroom to 16–18°C. Block all light sources — cover LEDs, use blackout curtains, and consider a sleep mask. Use earplugs or white noise if noise is a factor. Evaluate your mattress and pillow — they're not luxuries, they're sleep tools. If you're interested in specific product recommendations, our guides on mattresses, pillows, and bedding can help you choose.

10. Melatonin and Supplement Confusion

🛒 Recommended Products

Hand-picked products that align with the advice in this article.

As an Amazon Associate we earn from qualifying purchases. Prices may vary.

Disclosure: SleepReview is reader-supported. When you buy through links on our site, we may earn an affiliate commission. This comes at no extra cost to you and helps us keep providing free, independent advice. We never accept paid placements or sponsored reviews. Read our full affiliate disclosure.