Stable Diffusion XS, with a ControlNet based on sketch, can generate 2-4 images per second on a consumer grade desktop in the browser, at a total compressed size (text encoder, controlnet, u-net, autoencoder, all the pieces together) of under 400MB when compressed.