If by layers you mean tiles, you can make a server providing ZXY tile images. Some OSM clients (e.g. BRouter) allow adding custom tile servers for baselayer and overlays.

https://wiki.openstreetmap.org/wiki/Tile_servers