What is Bulkhead?

The Bulkhead pattern isolates components so that a failure in one doesn't bring down the entire system. Named after ship compartments that prevent a single breach from sinking the whole ship.

The Problem

Without isolation, one slow dependency affects everything:

The ProblemFlowchart

The Solution

Isolate resources for each dependency:

The SolutionFlowchart

Pool B is saturated by slow Service B, but Pools A and C are unaffected.

Bulkhead Types

Thread Pool Isolation

Separate thread pools for each dependency:

// Dedicated pool for Service A
ExecutorService serviceAPool = Executors.newFixedThreadPool(20);

// Dedicated pool for Service B
ExecutorService serviceBPool = Executors.newFixedThreadPool(30);

Semaphore Isolation

Limit concurrent calls with semaphores:

Semaphore serviceASemaphore = new Semaphore(20);

void callServiceA() {
    if (serviceASemaphore.tryAcquire()) {
        try {
            // Call service
        } finally {
            serviceASemaphore.release();
        }
    } else {
        // Reject request
    }
}

Comparison

Aspect	Thread Pool	Semaphore
Isolation	Full (separate threads)	Partial (shared threads)
Overhead	Higher	Lower
Timeout	Easy to implement	Harder
Best for	Untrusted dependencies	Trusted, fast calls

Architecture Example

Architecture ExampleFlowchart

Real-World Example

const Bottleneck = require('bottleneck');

// Bulkhead for external API
const externalApiLimiter = new Bottleneck({
    maxConcurrent: 10,    // Max concurrent requests
    minTime: 100          // Min time between requests
});

// Bulkhead for database
const dbLimiter = new Bottleneck({
    maxConcurrent: 50
});

// Usage
const result = await externalApiLimiter.schedule(() =>
    fetch('https://api.example.com')
);

Best Practices

Size pools appropriately: Based on dependency characteristics
Monitor pool usage: Alert on saturation
Combine with circuit breaker: Complementary patterns
Handle rejections gracefully: Fallback or fast-fail

Interview Tips

Explain the ship bulkhead analogy
Compare thread pool vs semaphore isolation
Discuss sizing strategies for pools
Mention combination with circuit breaker
Give examples: payment gateway, external APIs

Finished reading?

Mark it done to track your progress in Concepts.

Bulkhead

On this page