Thinset is not intended to do what you want, you don't want to build with it in that fashion. If you fill with panels you can then use thinset but only in a reasonable thickness as dictated by the size of the trowel you use.

Your thinset thickness would be around 1/8", certainly no more.
If you want to build with a mortar use masonry cement. Masonry cement can be heaped if necessary to take up space. You would then have to "beat" each paver into place and plane and level as you go. A lot more work actually.