Yes, you can both send and receive e-mail messages with attachments.
However, bear in mind that large attachments may slow down your mail sending/receiving.
Also, your email storage is part of your total storage space available. So if you send a lot of attachments, you should make a habit of storing them on your off of your server space. Same thing goes for attachments received from others.