Unfortunately clipping attachments don't (yet) have a Select checkbox like region or mesh attachments. However, you can turn off selection of Other on the main toolbar. This disables selection of clipping, bounding boxes, paths. You can still select them in the tree, which will select them in the viewport. Sometimes this can be faster than re-enabling selection, manipulating something, and then disabling again.
