Can I cancel an order from the dashboard?

Yes, but only if the order has not yet been shipped.

Once it is in the "Shipped" status, it is no longer recommended to cancel it through the system.