I don't think it would make any difference to speed as this is all done in shaders which operate on the R,G,B,A channels simultaneously. You can see them all here:
https://github.com/MickWest/sitrec/tree/main/src/shaders
e.g. the greyscale conversion:
fragmentShader: /* glsl */`...