You can do it with a single gate and a handful of passive parts. http://ieee-security.org/TC/SP2016/papers/0824a018.pdf
> I'm not too worried about backdoors in microcontrollers, they're too small to hide much.
Have you read the article "A2: Analog Malicious Hardware" ? You really don't need much space to insert a backdoor in silicon.