ECE 539 Digital Image Processing II - 3 hours credit

Professor: Dr. Scott E Umbaugh Office: Engineering Building, Room EB3037

Phone: 650-2524, 2948 e-mail: sumbaug@siue.edu

Class Format: Lecture and Project. Review lectures and topics of current interest in research areas of image processing, will be presented by the professor and guest lecturers. The students will also participate by presenting journal papers as well as their own term projects.

Description: Topics of current interest in image processing. Applications of image restoration, image enhancement, multi-dimensional image processing. Group projects.

Objectives: To familiarize the student with current areas of research interest in image processing. Various paper presentations by the professor and students, and seminars by researchers will be used to achieve this goal. The students will become familiar with the literature - journals, magazines, conferences, etc. - in this research area.

Prerequisite: ECE439 or consent of instructor

Reference Text(s): Digital Image Processing, 4th Edition, Gonzalez and Woods, Pearson, 2018; Digital Image Processing and Analysis: Digital Image Enhancement, Restoration and Compression, SE Umbaugh, Taylor&Francis/CRC Press, 2023

Supplementary documents are available at the publisher’s web site as Support Materials

COURSE SCHEDULE

Week

 

Summer

Fall

1

1,2

Image enhancement review, Meetings with professor for project discussion. Reading: Umbaugh – Chapter 6 ; Homework: Exercises 20-42, Supplementary exercises 1-9.

2

2,3

Image restoration review, Image reconstruction seminar; Image reconstruction, radon transform, backprojections, Fourier-slice theorem. Reading: Umbaugh – Chapter 7, Gonzalez & Woods – pp. 362-75, Homework – Umbaugh book; Chapter 7: Exercises 18-33, Supplementary exercises 1-8. NOTE: You can use your own homework on the Test

2

4

Work on homework, project research

3

5

Test, Project meetings

4

6

Journal paper/project proposal presentations, project meetings

5

7-9

Project meetings

6

10

Progress presentations by students, project meetings

7

11-14

Seminars, project meetings

8

15

Project presentations

Homework Solutions Chapters 6 and 7

 

GRADE:

  • 20% Quiz
  • 10% Project proposal and journal paper presentation
  •  5% Progress report presentation, class participation, meetings, notebooks
  • 65% term project – paper (see below), presentation

TERM PROJECT

Term Project: The project may be from one of the active research areas here at SIUE:

1. Skin Lesion Detection and Evaluation

2. Retinal Fundus Image Evaluation

3. Veterinary Thermographic Image Analysis.zip

4. Veterinary Thermographic Images Remapped

5. CVIPtools Development

6. Matlab CVIP Toolbox Development

Or a topic of your choice approved by the professor.

You may choose any project relating to image enhancement or restoration. You are to perform graduate level research in your area of choice and to build on previous work for your project. Projects will be individual in small classes or groups in large classes. There will be a maximum of 6 projects in a class.

A paper will be written describing the project and discussing what was learned during the project. The final paper will be about 25 to 50 pages, typed, double-spaced (excluding appendices). Include images in the paper!  If you are working a group you are required to submit three evaluations of the work performed by each member in your group, including yourself. These evaluations are as follows:

  • These are all confidential, the only person to see them is the Professor. The Professor will make final grade decisions.
  • Justify the grades you assign with specifics - for example, "we scheduled three meetings, student X always showed up prepared, or student Y was never on time and did not have their part of the project completed".
  • These will be emailed directly to me at sumbaug@siue.edu before each of the three milestones – proposal, progress report presentation and final report.
  • Include your name, group members names, which of the three milestones and the date. A short evaluation should be written about each member of your group, including yourself.
  • Two items for each person: 1) Your evaluation of their work in words. 2) A number of points based on the following:
  • 5 points are to be allotted for each person. If you feel each person contributed equally, give 5 points to each person. If you feel you did a little more, give yourself more than 5 and the others less. If you feel one person did all the work, give that person all the points and the others zero. In other words, distribute all the points according to the amount of work each person contributed to the project. Note that this is a zero-sum process - the total must add up to 5 times the number of members. These evaluations will be used as part of your grade, and will be used to determine individual project grades.

Ø  In addition to handing in a paper copy of the report, email me a soft copy of the Word file. Before you send me the file give it a meaningful name that includes your last name(s) and the project title.

Your final paper will conform to the following format:

Paper Format Outline

  • 1. Title page (project title, names, course number, date, etc.)
  • 2. Table of contents with page numbers for: different sections, figures, appendices, etc.
  • 3. Abstract - 1 page or less. Concise description of what is contained in the paper, include brief summary of results.
  • 4. Introduction/Project overview - about 1 to 2 pages.
  • 5. Body of paper. Broken down into sections as required for your part of the project. For example: Background/theory, experimental methods, discussion and analysis of results, program descriptions, etc. Present results using graphs, images, etc., about 10 to 25 pages
  • 6. Summary and conclusions. Summarize any results and draw conclusions as based on these results. About 1 to 4 pages.
  • 7. Suggestions for future work. Include any ideas you have based on your work and conclusions about followup experiments and/or research. 1 to 2 pages.
  • 8. References. Be sure your references are complete. Avoid web sites as references – these come and go – find the source, which is usually a published paper.
  • 9. Appendices - related background information, program listings, etc.

General: reports should be typed, double spaced, pages numbered starting with abstract. The number of pages listed above are only guidelines, do what is necessary, but keep it concise. DO NOT put in plastic folder, simply staple in upper left hand corner.

The students will give a presentation of the project during the last week of the semester.

Grading: The project is worth 65% of your grade, broken down as follows:

  • - 15% Difficulty and complexity
  • - 20% Quality of work and success
  • - 10% Quantity of work
  • - 10% Project paper
  • - 10% Project presentation

Suggested Project Process:

  • 1) Define the project you wish to pursue
  • 2) Library/Internet research for existing algorithms
  • 3) Acquire image database for training and testing
  • 4) Use CVIPtools for preliminary analysis
  • 5) Define C or Matlab function(s), to implement project
  • 6) Code and debug your function(s)
  • 7) Develop your algorithms with training image set
  • 8) Process test images/do the experiments
  • 9) Analyze results using appropriate metrics, tabulate or plot, etc.
  • 10) Write report, include images
  • 11) Demonstration to the class

Class Attendance Policy: Based on University Class Attendance Policy 1I9: It is the responsibility of students to ascertain the policies of instructors with regard to absence from class, and to make arrangements satisfactory to instructors with regard to missed course work. Failure to attend the first session of a course may result in the student’s place in class being assigned to another student.

Class Policies:  If you have a documented disability that requires academic accommodations, please go to Disability Support Services for coordination of your academic accommodations. DSS is located in the Student Success Center, Room 1270; you may contact them to make an appointment by calling (618) 650-3726 or sending an email to disabilitysupport@siue.edu.  Please visit the DSS website located online at: www.siue.edu/dss  for more information.

Students are expected to be familiar with and follow the Student Academic Code. It is included in the SIUE Policies and Procedures under Section 3C2.2.

COMPUTER RESOURCES AVAILABLE

Hardware:

  • 13 Windows imaging workstations, frame grabber and image compression boards
  • HP color scanner, 1200 dpi
  • HP Color Laser Printer
  • Digitizing stations with CCD cameras, zoom and standard lenses, controlled light boxes
  • Sony digital Mavica still/MPEG camera, XGA resolution (768x1024)
  • Canesta’s DP205 3-D camera

Software:

  • CVIPtools: a comprehensive Computer Vision and Image Processing package developed at SIUE – Windows and UNIX
  • MATLAB: CVIP, Image Processing, Neural Network, and Digital Signal Processing Toolboxes
  • PARTEK: Pattern Recognition software with tutorials, comprehensive statistical pattern recognition and some neural network functions - Windows
  • Image databases: Image Databases
  • Microsoft Office, word processing, presentations, etc
  • Microsoft Visual Studio

THE RESEARCH ENGINEER'S NOTEBOOK

NOTE: In ECE 539 you are required to keep a research engineer's notebook which will be reviewed by the professor during group meetings.

INTRODUCTION: The technical notebook is one of the most important tools for any engineering work. This includes: basic research, product development, or engineering design. It is primarily for the researcher's own use, but another person with similar technical background should be able to understand and duplicate any experiment, data, and conclusion, or to prepare a technical report following only the notebook.

There are many reasons to keep an accurate and complete record of your work:

  • to establish the authenticity of the work.
  • to defend patents.
  • to act as a basis for technical reports and articles.
  • to avoid duplication of effort.

The nature of the work and the purpose of the research will influence the content and format of the notebook.

CONTENT REQUIREMENTS: The notebook must be understandable to a person with a comparable technical background. It must be legible. It must be complete; for example, "We got code from book" is NOT an acceptable entry - what code ?, what page ?, what does it do ?, did you have to recompile it ?, etc.

The notebook must answer the following questions:

  • WHAT WAS DONE? This includes the approach to the research problem. Any ideas generated should be included. Algorithmic flowcharts, references used, notes taken, etc. should be included.
  • WHO DID IT? List all those who participate in the project for a given entry, including yourself, at the beginning of each entry. Any corrections or alterations should be initialed.
  • WHEN WAS IT DONE? It must be obvious to any reader when the work was performed. Date all pages and entries; entries that extend beyond one page should be dated on each page. Do not leave blank spaces and NEVER "back-date" entries (NEVER make ANY false entries in your engineering notebook).

General: The typical engineers notebook available in bookstores will be blue, brown or black, is approximately 9" X 12", and has about 100 to 150 pages. The notebook will be bound, never loose-leaf, and the pages should be numbered consecutively, preferably by the printer. For the our purposes you may use spiral notebooks, as long as each page is numbered and each entry is dated.

A neat, organized and complete notebook record is as important as the investigation itself. The notebook is the original record of what was done. It is not a report to be written after completing an investigation. Do not write on scratch paper expecting to transfer it later to the notebook. Use a blue or black non-erasable pen. Errors are not erased, but simply marked through with a single line so that they still can be read - later you may discover that your "error" contains important information.

Leave the first page or two in the notebook blank for a Table of Contents. This is necessary so that your work can easily be referenced. Use only the right-hand, odd-numbered pages for the notebook record. Use the left-hand, even-numbered pages for sketches, rough calculations, and memos to yourself. You may also place diagrams and graphs on the left, opposite corresponding procedures and calculations. Do not leave any blank spaces/pages in the notebook.

Format - Technical Diary

Organization of this format type is left to the engineer. This format is suited to experimental work, design work, and research. The general format and content requirements must be met. Notes, program code, flowcharts, procedures, data, and calculations are blended together logically and chronologically to form a step-by- step diary describing work. Observations and conclusions are entered as they are made, and summarized at the logical end of a section. This format is well suited for research.

Brief Bibliography

Books

  • Digital Image Processing, R.C.Gonzalez & R.Woods, Addison-Wesley, 2002
  • 1. Computer and Robot Vision, R.M. Haralick and L.G. Shapiro, Addison-Wesley, 1992
  • 2. Machine Vision, Jain, Kasturi, Schnuck, McGraw-Hill, 1995
  • 3. Robot Vision, B.K.P.Horn, MIT Press, 1986
  • 4. Computer Vision, D.H.Ballard & C.M.Brown, Prentice Hall, 1982
  • 5. Object Recognition by Computer, W.E.L. Grimson, MIT Press, 1990
  • 6. Syntactic Pattern Recognition: An Introduction, R.C.Gonzalez and M.G.Thomason
  • 7. Pattern Classification and Scene Analysis, R.O. Duda and P.E. Hart, Wiley 1973
  • 8. Pattern Recognition Statistical, Structural and Neural Approaches, R.J Schalkoff, Wiley, 1992
  • 9. Artificial Intelligence: An Engineering Approach, R.J. Schalkoff, McGraw-Hill, 1990
  • 10. Pattern Recognition Engineering, M. Nadler and E.P. Smith, Wiley, 1993
  • 11. Digital Image Processing and Computer Vision, R.J. Schalkoff, Wiley, 1989
  • 12. The Image Processing Handbook, J.C. Russ, CRC Press, 1992
  • 13. Digital Image Processing, K.R. Castleman, Prentice Hall, 1996
  • 14. Digital Image Processing, R.C.Gonzalez & R.Woods, Addison-Wesley, 1992
  • 15. Digital Image Processing, W.K. Pratt, Wiley 1991
  • 16. Fundamentals of Digital Image Processing, A.K. Jain, Prentice Hall, 1989
  • 17. Digital Picture Processing, A. Rosenfeld and A.C. Kak, Academic Press 1982
  • 18. Digital Pictures, A.N. Netravali and B.G. Haskell, Plenum Press 1988
  • 19. Vision in Man and Machine, M.D. Levine, McGraw Hill 1985

Journals

  • 1. IEEE Transactions on Image Processing
  • 2. IEEE Engineering in Medicine and Biology
  • 3. Computer Vision, Graphics and Image Processing (CVGIP)
  • 4. CVGIP: Graphical Models and Image Processing
  • 5. CVGIP: Image Understanding
  • 6. IEEE Transactions on Medical Imaging
  • 7. Computerized Medical Imaging and Graphics
  • 8. IEEE Transactions on Pattern Analysis and Machine Intelligence
  • 9. IEEE Transactions on Computers
  • 10. Pattern Recognition
  • 11. IEEE Transactions on Signal Processing
  • 12. IEEE Transactions on Neural Networks
  • 13. IEEE Transactions on Geoscience and Remote Sensing
  • 14. Photogrammetric Engineering and Remote Sensing
  • 15. International Journal of Remote Sensing
  • 16. Journal of Visual Communication and Image Representation
  • 17. IEEE Transactions on Robotics and Automation
  • 18. ACM Siggraph publications
  • 19. Numerous Conference Proceedings and other journals from:

IEEE - Institute of Electrical and Electronic Engineers

SPIE - The International Society for Optical Engineering

SMPTE - The Society of Motion Picture and Television Engineers

PRS - Pattern Recognition Society

ACM - Association for Computing Machinery