Does de-activated plugins slow down a WordPress site?

No, de-activated plugins cannot slow down the WordPress site. WordPress only loads the active plugins and ignores everything else.