Do you get colder wearing skirts than trousers?

Yes you get a little colder. Don't know how long your skirt is but try wearing leggings or tights under the skirt.