In PrestaShop v1.4, you can use arrows just like the products to rearrange categories.
In PrestaShop v1.3 and below, categories are always sorted alphabetically, unless you add a number prefix like this:
01.Category 1
02.Category 2
PrestaShop will use that number to sort the categories, then remove it so that only Category 1 and Category 2 are displayed.