Cancer-Detection
Machine learning aids in many of our day-to-day ordeals in normal life. Some of the most powerful uses of machine learning are in the medical field. In this repository, the viability of artificial neural networks and support vector machines in tumor malignancy classification is tested.
Simplified Pipeline
Step 1: Data acquisition
- A publically available UCI Wisconsin breast cancer dataset is downloaded. Within this dataset, features are computed from a digitized image of a fine needle aspirate (FNA) of a breast mass.
Step 2: Data visualization
- To effectively identifiy relationships within the data itself, a heatmap of all 31 features within the data is created.
Step 3: Data pre-processing
-
Attributes are seperated according to the following specifications:
- The first attribute of each sample is an ID number and is discarded
- Y (attribute 31): This final attribute is the tumor classification, malignant and benign, represented numerically as either 1 or 0. This feature is separated from the rest of the data. This is referred to as the target feature.
- X (attributes 1 - 30): These remaining features are the predictors (mean radius, mean texture, mean perimeter, mean area, mean smoothness, etc.), which will be inputted into machine learning models
The data is also split into to sets, training and testing.
Step 4: Create and train an Artificial Neural Network.
- Modern neural networks come in many shapes and sizes. For this project, a simple 5 layer neural network was chosen for it's decent performance with minimal computational overhead.
Step 6: Create and train a Support Vector Machine
- The SVM model is explicitly searching for the best separating line between the two classes of data. This is done by first searching for the two closest overlapping samples and finding a line, typically linear, that connects them. The SVM then declares that the best separating line is the line that bisects is perpendicular to the connecting line. This is repeated with many overlapping samples until the number of samples misclassified is minimized or, more generally, until the distance between the separating line and both classes of data is maximized.
Step 7: Evaluate and visualize
- Post Training, data from both data sets is stepped through both machine learning methods. This evaluation data is used generate the result plots.
Results
Come see the results and more at my github repository.
jarulsamy
/
Cancer-Detection
Cancer Detection with Machine Learning
Cancer-Detection
Method
Step 1: Data acquisition A UCI Wisconsin dataset (1995) will be downloaded from the UCI machine learning repository (https://archive.ics.uci.edu/ml/datasets/Breast+Cancer+Wisconsin+(Diagnostic) To train and evaluate a machine learning model, a sufficiently large dataset of mammogram samples must be acquired. Within this dataset, features are computed from a digitized image of a fine needle aspirate (FNA) of a breast mass. They describe characteristics of the cell nuclei present in the image. This dataset contains 569 samples, each with 32 attributes.
Step 2: Data visualization Create a correlation map Determining relationships within the data can aid in deciding which machine learning methods to use. Therefore, the relationships between their various attributes are visualized.
Step 3: Data pre-processing Restructure the data and prepare for inputting into machine learning models This dataset is provided in a CSV file format. To accelerate the training process, all 569 samples are first loaded into working…
Top comments (0)