$a and $b are assigned the actual array elements, not the index to them.
So I believe that this will do what you want:

@sorted = sort {$a->size() <=> $b->size()} @$setarray;
[download]

---- kurt