Some crinoids (sea lilies) have columnals that are squarish, eg. Xenocrinus. But those tend to have central canals that are considerably smaller than yours percentage-wise. Your fragments are also different in that the canals are round in cross section.
I note your fragments show, in many cases, concave edges. That helps lead me to think they may be annelid worm tubes. We see yours mainly in cross section, but they look like what is shown here in 3D, and tentatively IDd there as Genicularia vertibralis. These are commonly associated with the Jurassic Oxford Clay. Here are some pieces for sale on Amazon - http://www.amazon.co.uk/FS9908-Jurassic-Annelid-Worm-10-15mm/dp/9980454318 (I wouldn't niomally refer to material for sale, but there are few useful photos to be found). But there are records from other strata and locations.
19th Century books refer to Serpula quadrangularis; that and S. rustica have 4-sided tubes.