Hard drives (or controllers, rather) capable of hot-swapping (that is, plugging and un-plugging a drive into a running system) used to be a feature reserved for expensive professional RAID installations.
With the advent of SATA in the mainstream, that has changed. Supposedly any SATA hard drive can be hot-plugged now. But what if you actually try and nothing happens? Chances are your controller doesn't let the OS know about the newly found drive on its own.
Try this to rescan the SCSI hosts (each SATA port appears as a SCSI bus):
echo "0 0 0" >/sys/class/scsi_host/host<n>/scan
and to remove a drive:
echo x > /sys/bus/scsi/devices/<n>:0:0:0/delete
Replace <n>
with the right numbers for your system, respectively.
Also, just to state the obvious, don't do that to a mounted drive, ever. Especially not the one that holds your system partition ;)
(via.)